Apr 08 15:43:59 devstack cinder-volume[72329]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 15:43:59 devstack cinder-volume[72329]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 15:43:59 devstack cinder-volume[72329]: we strongly recommend against using it for new projects. Apr 08 15:43:59 devstack cinder-volume[72329]: If you are already using Eventlet, we recommend migrating to a different Apr 08 15:43:59 devstack cinder-volume[72329]: framework. For more detail see Apr 08 15:43:59 devstack cinder-volume[72329]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 15:43:59 devstack cinder-volume[72329]: import eventlet # noqa Apr 08 15:44:01 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:44:01 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:44:01 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO dbcounter [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Registered counter for database cinder Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_db.sqlalchemy.engines [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writer thread running {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.rpc [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.rpc [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_db.sqlalchemy.engines [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Determined volume DB was empty at startup. Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG cinder.volume.manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72329) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING stevedore.named [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING castellan.key_manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING cinder.keymgr.conf_key_mgr [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG cinder.volume.drivers.lvm [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72329) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_concurrency.processutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] CMD "cinder-rtstool verify" returned: 0 in 0.224s {{(pid=72329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_db.sqlalchemy.engines [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.rpc [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.rpc [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING stevedore.named [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING castellan.key_manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:44:02 devstack cinder-volume[72329]: INFO cinder.volume.manager [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_db.sqlalchemy.engines [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:44:02 devstack cinder-volume[72329]: INFO oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Starting 1 workers Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Started child 72433 {{(pid=72329) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Full set of CONF: {{(pid=72329) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] ******************************************************************************** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Configuration options gathered from: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] ================================================================================ {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] allow_availability_zone_fallback = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] allow_compression_on_image_upload = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] allowed_direct_url_schemes = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] api_rate_limit = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] auth_strategy = keystone {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] az_cache_duration = 3600 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_availability_zone = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_host = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_stats_polling_interval = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backup_api_class = cinder.backup.api.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backup_name_template = backup-%s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backup_use_same_host = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backup_use_temp_snapshot = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] chap_password = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] chap_username = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_internal_tenant_project_id = 74487bcbf623420fb29c39f784b7b0b7 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_internal_tenant_user_id = beb7d6c657e54583b80e1691cab545b5 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cloned_volume_same_az = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cluster = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] compression_format = gzip {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] compute_api_class = cinder.compute.nova.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] config_dir = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] config_source = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] control_exchange = openstack {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] debug = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] default_availability_zone = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] default_group_type = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72433]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] default_volume_type = lvmdriver-1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] disk_geometry = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_client_cert = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_client_cert_key = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_data_namespace = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_ssl_cert_path = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_ssl_cert_verify = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] driver_use_ssl = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] enable_force_upload = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] enable_new_services = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] enable_unsupported_driver = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] enabled_backends = ['lvmdriver-1'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] enforce_multipath_for_image_xfer = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] filter_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_api_insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_api_ssl_compression = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_ca_certificates_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_catalog_info = image:glance:publicURL {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_num_retries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance_request_timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] goodness_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] graceful_shutdown_timeout = 5 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] group_api_class = cinder.group.api.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] host = devstack {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_compress_on_upload = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_conversion_address_space_limit = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_conversion_cpu_limit = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_conversion_disable = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_upload_use_cinder_backend = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_upload_use_internal_tenant = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_volume_cache_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_volume_cache_max_count = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] image_volume_cache_max_size_gb = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] init_host_max_objects_retrieval = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] instance_format = [instance: %(uuid)s] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iscsi_target_flags = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iscsi_write_cache = on {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iser_helper = tgtadm {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iser_ip_address = 192.168.122.196 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iser_port = 3260 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_color = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_config_append = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_dir = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_options = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_rotate_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_rotate_interval_type = days {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] log_rotation_type = none {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] max_age = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] max_logfile_count = 30 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] max_logfile_size_mb = 200 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] max_over_subscription_ratio = 20.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] message_reap_interval = 86400 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] message_ttl = 2592000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] migration_create_volume_timeout_secs = 300 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] monkey_patch = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] monkey_patch_modules = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] my_ip = 192.168.122.196 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] no_snapshot_gb_quota = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] num_iser_scan_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] num_shell_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] num_volume_device_scan_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] nvmeof_conn_info_version = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] nvmet_ns_id = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] nvmet_port_id = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_max_limit = 1000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_ext_list = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_listen = 0.0.0.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_listen_port = 8776 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_use_ssl = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] osapi_volume_workers = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] per_volume_size_limit = -1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] periodic_fuzzy_delay = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] periodic_interval = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] project_id_regex = [0-9a-f\-]+ {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] public_endpoint = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72433]: INFO cinder.volume.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] publish_errors = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_backup_gigabytes = 1000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_backups = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_gigabytes = 1000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_groups = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_snapshots = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] quota_volumes = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] rate_limit_burst = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] rate_limit_except_level = CRITICAL {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] rate_limit_interval = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] reinit_driver_count = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] replication_device = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] report_discard_supported = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] report_interval = 120 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] reservation_clean_interval = 86400 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] reservation_expire = 86400 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] reserved_image_namespaces = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] reserved_percentage = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] rpc_response_timeout = 120 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] run_external_periodic_tasks = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] scst_target_driver = iscsi {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] scst_target_iqn_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_down_time = 720 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] shell_completion = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] snapshot_name_template = snapshot-%s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] snapshot_same_host = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] split_loggers = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] state_path = /opt/stack/data/cinder {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] storage_availability_zone = nova {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] storage_protocol = iSCSI {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] syslog_log_facility = LOG_USER {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_helper = lioadm {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_ip_address = 192.168.122.196 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_port = 3260 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_protocol = iscsi {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] target_secondary_ip_addresses = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] trace_flags = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] transfer_api_class = cinder.transfer.api.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] transport_url = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] until_refresh = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_chap_auth = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_default_quota_class = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_journal = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_json = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_multipath_for_image_xfer = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_stderr = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] use_syslog = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] verify_glance_signatures = enabled {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_api_class = cinder.volume.api.API {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_backend_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_clear = zero {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_clear_ionice = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_clear_size = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_copy_bps_limit = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_dd_blocksize = 1M {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_name_template = volume-%s {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_service_inithost_offload = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volume_usage_audit_period = month {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] zoning_mode = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_concurrency.disable_process_locking = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.admin_password = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.admin_token = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.admin_user = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_admin_prefix = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_port = 35357 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_protocol = https {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_section = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_type = password {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_uri = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.auth_version = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.cache = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.delay_auth_decision = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.http_connect_timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.identity_uri = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.include_service_catalog = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.interface = public {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_password = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcache_username = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.region_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.service_token_roles_required = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.service_type = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.token_cache_time = 300 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.backend = dogpile.cache.null {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.backend_argument = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.backend_expiration_time = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.config_prefix = cache.oslo {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.debug_cache_backend = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.enable_retry_client = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.enable_socket_keepalive = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.enforce_fips_mode = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.expiration_time = 600 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.hashclient_retry_attempts = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:02 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_dead_retry = 300 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_pool_maxsize = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_sasl_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.password = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.proxies = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.redis_db = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.redis_sentinel_service_name = mymaster {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.redis_server = localhost:6379 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.retry_attempts = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.retry_delay = 0.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.socket_keepalive_count = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.socket_keepalive_idle = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.socket_keepalive_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.socket_timeout = 1.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.tls_allowed_ciphers = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.tls_cafile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.tls_certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.tls_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.tls_keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cache.username = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] coordination.backend_url = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.asyncio_connection = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.asyncio_slave_connection = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.backend = sqlalchemy {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.connection = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.connection_debug = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.connection_parameters = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.connection_recycle_time = 3600 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.connection_trace = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.db_inc_retry_interval = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.db_max_retries = 20 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.db_max_retry_interval = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.db_retry_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.max_overflow = 50 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.max_pool_size = 5 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.max_retries = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.mysql_wsrep_sync_wait = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.pool_timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.retry_interval = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.slave_connection = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.sqlite_synchronous = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.synchronous_reader = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] database.use_db_reconnect = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.connection_string = messaging:// {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.es_doc_type = notification {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.es_scroll_size = 10000 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack sudo[72437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.es_scroll_time = 2m {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.filter_error_trace = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.hmac_keys = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack sudo[72437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.sentinel_service_name = mymaster {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.socket_timeout = 0.1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.trace_requests = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler.trace_sqlalchemy = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler_jaeger.process_tags = {} {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler_jaeger.service_name_prefix = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] profiler_otlp.service_name_prefix = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.enforce_new_defaults = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: WARNING oslo_config.cfg [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.enforce_scope = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.policy_default_rule = default {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.policy_file = policy.yaml {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_policy.remote_timeout = 60.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.group = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.helper_command = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] privsep_osbrick.user = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.group = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.helper_command = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] cinder_sys_admin.user = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.auth_section = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.auth_type = password {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.cafile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.collect_timing = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.send_service_user_token = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.split_loggers = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] service_user.timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.auth_section = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.auth_type = password {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.collect_timing = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.region_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.split_loggers = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] glance.timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.backend_availability_zone = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.chap_password = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.chap_username = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.disk_geometry = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_client_cert = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_client_cert_key = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_data_namespace = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.driver_use_ssl = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.enable_unsupported_driver = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.extra_capabilities = {} {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.filter_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.goodness_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iscsi_target_flags = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iscsi_write_cache = on {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iser_helper = tgtadm {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iser_port = 3260 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.lvm_mirrors = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.lvm_share_target = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.lvm_type = auto {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.num_shell_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.nvmet_port_id = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.replication_device = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.report_discard_supported = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.reserved_percentage = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.scst_target_driver = iscsi {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.scst_target_iqn_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.storage_protocol = iSCSI {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_helper = tgtadm {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_port = 3260 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_protocol = iscsi {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.trace_flags = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.unique_fqdn_network = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.use_chap_auth = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_backend_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_clear = zero {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_clear_ionice = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_clear_size = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volume_group = cinder-volumes {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_reports.file_event_handler = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_reports.log_dir = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.backend_availability_zone = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.backend_host = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.chap_password = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.chap_username = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.chiscsi_conf = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.disk_geometry = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_client_cert = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_data_namespace = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.driver_use_ssl = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.extra_capabilities = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.filter_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.goodness_function = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iser_helper = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iser_ip_address = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iser_port = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.iser_target_prefix = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.lvm_conf_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.lvm_mirrors = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.lvm_share_target = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.lvm_type = auto {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.num_shell_tries = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.nvmet_port_id = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.replication_device = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.report_discard_supported = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.reserved_percentage = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.scst_target_driver = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.storage_protocol = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_helper = lioadm {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_ip_address = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_port = 3260 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_protocol = iscsi {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.trace_flags = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.use_chap_auth = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_clear = zero {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_clear_size = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] lvmdriver-1.volumes_dir = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.ssl_version = {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_notifications.driver = [] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_notifications.retry = -1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] key_manager.fixed_key = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.barbican_api_version = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.barbican_endpoint = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.barbican_endpoint_type = public {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.barbican_region_name = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.cafile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.collect_timing = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.number_of_retries = 60 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.retry_delay = 1 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.send_service_user_token = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.split_loggers = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.verify_ssl = True {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican.verify_ssl_path = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.auth_section = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.auth_type = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.cafile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.certfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.collect_timing = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.insecure = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.keyfile = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.split_loggers = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] barbican_service_user.timeout = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.approle_role_id = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.approle_secret_id = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.kv_mountpoint = secret {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.kv_path = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.kv_version = 2 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.namespace = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.root_token_id = **** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.ssl_ca_crt_file = None {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.timeout = 60.0 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.use_ssl = False {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:44:02 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] ******************************************************************************** {{(pid=72329) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 15:44:03 devstack sudo[72437]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:03 devstack sudo[72570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:03 devstack sudo[72570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:03 devstack sudo[72570]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.521s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:44:03 devstack cinder-volume[72433]: INFO cinder.brick.local_dev.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:03 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:04 devstack sudo[72808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:04 devstack sudo[72808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:04 devstack sudo[72808]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:04 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:04 devstack cinder-volume[72433]: DEBUG cinder.brick.local_dev.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72433) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 08 15:44:04 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:04 devstack sudo[72963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:04 devstack sudo[72963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:05 devstack sudo[72963]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.805s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:05 devstack sudo[73106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:05 devstack sudo[73106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:05 devstack sudo[73106]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:05 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:05 devstack sudo[73131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 08 15:44:05 devstack sudo[73131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:06 devstack sudo[73131]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:06 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.472s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:06 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:06 devstack sudo[73134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:06 devstack sudo[73134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:06 devstack sudo[73134]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:06 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:06 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:06 devstack sudo[73139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:06 devstack sudo[73139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:07 devstack sudo[73139]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:07 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:07 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:07 devstack sudo[73142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:07 devstack sudo[73142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:07 devstack sudo[73142]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:07 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:07 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:07 devstack sudo[73150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:07 devstack sudo[73150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:08 devstack sudo[73150]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:08 devstack sudo[73154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:08 devstack sudo[73154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:08 devstack sudo[73154]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:08 devstack cinder-volume[72433]: INFO cinder.volume.drivers.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:08 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:08 devstack sudo[73213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:08 devstack sudo[73213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:09 devstack sudo[73213]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:09 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:09 devstack cinder-volume[72433]: DEBUG cinder.volume.drivers.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Updating volume stats {{(pid=72433) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 15:44:09 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:09 devstack sudo[73280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:09 devstack sudo[73280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:09 devstack sudo[73280]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:09 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:09 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:09 devstack sudo[73419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:09 devstack sudo[73419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:10 devstack sudo[73419]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:10 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:10 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:10 devstack sudo[73423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:10 devstack sudo[73423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:10 devstack sudo[73423]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:10 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:10 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:10 devstack sudo[73427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:10 devstack sudo[73427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:11 devstack sudo[73427]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:11 devstack cinder-volume[72433]: INFO cinder.volume.driver [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Driver hasn't implemented _init_vendor_properties() Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG cinder.volume.driver [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72433) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG oslo_db.sqlalchemy.engines [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG dbcounter [-] [72433] Writer thread running {{(pid=72433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG cinder.db.sqlalchemy.api [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Building query based on filter {{(pid=72433) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG cinder.image.image_utils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72433) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 15:44:11 devstack cinder-volume[72433]: INFO cinder.keymgr.migration [None req-6639b8a1-e109-482a-adb2-6bf6934085fc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG cinder.volume.drivers.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Updating volume stats {{(pid=72433) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:11 devstack sudo[73434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:11 devstack sudo[73434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:11 devstack sudo[73434]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:11 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:11 devstack sudo[73437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:11 devstack sudo[73437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:12 devstack sudo[73437]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:12 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:12 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:12 devstack sudo[73443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:12 devstack sudo[73443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:12 devstack cinder-volume[72329]: DEBUG dbcounter [-] [72329] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72329) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:44:12 devstack sudo[73443]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:12 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:12 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:12 devstack sudo[73447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:12 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:13 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG cinder.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Notifying Schedulers of capabilities ... {{(pid=72433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:44:13 devstack cinder-volume[72433]: INFO cinder.volume.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Driver initialization completed successfully. Apr 08 15:44:13 devstack cinder-volume[72433]: INFO cinder.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Initiating service 2 cleanup Apr 08 15:44:13 devstack cinder-volume[72433]: INFO cinder.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Service 2 cleanup completed. Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG cinder.service [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Creating RPC server for service cinder-volume {{(pid=72433) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG cinder.service [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72433) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 15:44:13 devstack cinder-volume[72433]: INFO cinder.volume.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG cinder.volume.drivers.lvm [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Updating volume stats {{(pid=72433) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:13 devstack sudo[73455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:44:13 devstack sudo[73455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:13 devstack sudo[73455]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:13 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:13 devstack sudo[73470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:13 devstack sudo[73470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:14 devstack sudo[73470]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:14 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:14 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:14 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:44:14 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:14 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:14 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:14 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:44:14 devstack sudo[73519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:44:14 devstack sudo[73519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:44:15 devstack sudo[73519]: pam_unix(sudo:session): session closed for user root Apr 08 15:44:15 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:44:15 devstack cinder-volume[72433]: INFO cinder.volume.manager [None req-d37ae646-d123-44dc-926b-cc3d69690013 None None] Driver post RPC initialization completed successfully. Apr 08 15:44:25 devstack cinder-volume[72433]: DEBUG dbcounter [-] [72433] Writing DB stats cinder:SELECT=4 {{(pid=72433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:44:25 devstack cinder-volume[72433]: DEBUG dbcounter [-] [72433] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:45:49 devstack cinder-volume[72433]: DEBUG oslo_service.periodic_task [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72433) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:45:49 devstack cinder-volume[72433]: DEBUG cinder.volume.drivers.lvm [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Updating volume stats {{(pid=72433) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 15:45:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:45:49 devstack sudo[78550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:45:49 devstack sudo[78550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:45:49 devstack sudo[78550]: pam_unix(sudo:session): session closed for user root Apr 08 15:45:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:45:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:45:49 devstack sudo[78553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:45:49 devstack sudo[78553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:45:50 devstack sudo[78553]: pam_unix(sudo:session): session closed for user root Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:45:50 devstack sudo[78556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:45:50 devstack sudo[78556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:45:50 devstack sudo[78556]: pam_unix(sudo:session): session closed for user root Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:45:50 devstack sudo[78559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:45:50 devstack sudo[78559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:45:50 devstack sudo[78559]: pam_unix(sudo:session): session closed for user root Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:45:50 devstack cinder-volume[72433]: DEBUG cinder.manager [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Notifying Schedulers of capabilities ... {{(pid=72433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:46:25 devstack cinder-volume[72433]: DEBUG dbcounter [-] [72433] Writing DB stats cinder:SELECT=1 {{(pid=72433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:46:25 devstack cinder-volume[72433]: DEBUG dbcounter [-] [72433] Writing DB stats cinder:UPDATE=1 {{(pid=72433) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:46:49 devstack cinder-volume[72433]: DEBUG oslo_service.periodic_task [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72433) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:46:49 devstack cinder-volume[72433]: DEBUG cinder.volume.drivers.lvm [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Updating volume stats {{(pid=72433) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 15:46:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:46:49 devstack sudo[80620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 15:46:49 devstack sudo[80620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:46:49 devstack sudo[80620]: pam_unix(sudo:session): session closed for user root Apr 08 15:46:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:46:49 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:46:49 devstack sudo[80626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:46:49 devstack sudo[80626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:46:50 devstack sudo[80626]: pam_unix(sudo:session): session closed for user root Apr 08 15:46:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:46:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:46:50 devstack sudo[80629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 15:46:50 devstack sudo[80629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:46:50 devstack sudo[80629]: pam_unix(sudo:session): session closed for user root Apr 08 15:46:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:46:50 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:46:50 devstack sudo[80633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 15:46:50 devstack sudo[80633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:46:51 devstack sudo[80633]: pam_unix(sudo:session): session closed for user root Apr 08 15:46:51 devstack cinder-volume[72433]: DEBUG oslo_concurrency.processutils [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72433) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:46:51 devstack cinder-volume[72433]: DEBUG cinder.manager [None req-e81bfdbe-2c8a-48c2-83ac-a24ac54d72c1 None None] Notifying Schedulers of capabilities ... {{(pid=72433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:47:38 devstack cinder-volume[72329]: INFO oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Caught SIGTERM, stopping children Apr 08 15:47:38 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Acquiring lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:38 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Acquired lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:38 devstack cinder-volume[72329]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Releasing lock "singleton_lock" {{(pid=72329) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:38 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Stop services. {{(pid=72329) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 08 15:47:38 devstack cinder-volume[72329]: DEBUG oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Killing children. {{(pid=72329) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 08 15:47:38 devstack cinder-volume[72329]: INFO oslo_service.backend._eventlet.service [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Waiting on 1 children to exit Apr 08 15:47:43 devstack cinder-volume[72433]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 08 15:47:43 devstack cinder-volume[81672]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 15:47:43 devstack cinder-volume[81672]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 15:47:43 devstack cinder-volume[81672]: we strongly recommend against using it for new projects. Apr 08 15:47:43 devstack cinder-volume[81672]: If you are already using Eventlet, we recommend migrating to a different Apr 08 15:47:43 devstack cinder-volume[81672]: framework. For more detail see Apr 08 15:47:43 devstack cinder-volume[81672]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 15:47:43 devstack cinder-volume[81672]: import eventlet # noqa Apr 08 15:47:45 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:45 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:45 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:46 devstack cinder-volume[81672]: INFO dbcounter [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Registered counter for database cinder Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_db.sqlalchemy.engines [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG dbcounter [-] [81672] Writer thread running {{(pid=81672) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:47:46 devstack cinder-volume[81672]: INFO cinder.rpc [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 15:47:46 devstack cinder-volume[81672]: INFO cinder.rpc [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_db.sqlalchemy.engines [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:46 devstack cinder-volume[81672]: INFO cinder.volume.manager [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Determined volume DB was empty at startup. Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG cinder.volume.manager [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81672) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 15:47:46 devstack cinder-volume[81672]: INFO cinder.volume.manager [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 08 15:47:46 devstack cinder-volume[81672]: WARNING stevedore.named [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 15:47:46 devstack cinder-volume[81672]: WARNING castellan.key_manager [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:47:46 devstack cinder-volume[81672]: WARNING cinder.keymgr.conf_key_mgr [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:47:46 devstack cinder-volume[81672]: INFO cinder.volume.manager [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_db.sqlalchemy.engines [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:46 devstack cinder-volume[81672]: INFO oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Starting 1 workers Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Started child 81787 {{(pid=81672) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Full set of CONF: {{(pid=81672) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] ******************************************************************************** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Configuration options gathered from: {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] ================================================================================ {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] allow_availability_zone_fallback = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] allow_compression_on_image_upload = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] allowed_direct_url_schemes = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] api_rate_limit = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] auth_strategy = keystone {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_availability_zone = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_host = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_stats_polling_interval = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backup_api_class = cinder.backup.api.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backup_name_template = backup-%s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backup_use_same_host = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backup_use_temp_snapshot = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] chap_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] chap_username = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_internal_tenant_project_id = 74487bcbf623420fb29c39f784b7b0b7 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_internal_tenant_user_id = beb7d6c657e54583b80e1691cab545b5 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cluster = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] compression_format = gzip {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] compute_api_class = cinder.compute.nova.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] config_dir = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] config_source = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] control_exchange = openstack {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] debug = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] default_availability_zone = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] default_group_type = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] default_volume_type = QuobyteHD {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] disk_geometry = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_client_cert = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_client_cert_key = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_data_namespace = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_ssl_cert_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_ssl_cert_verify = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] driver_use_ssl = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] enable_new_services = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] enable_unsupported_driver = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81787]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] enabled_backends = ['QuobyteHD'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] enforce_multipath_for_image_xfer = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] filter_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_api_insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_api_ssl_compression = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_ca_certificates_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_catalog_info = image:glance:publicURL {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_num_retries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance_request_timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] goodness_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] graceful_shutdown_timeout = 5 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] group_api_class = cinder.group.api.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] host = devstack {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_compress_on_upload = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_conversion_address_space_limit = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_conversion_cpu_limit = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_conversion_disable = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_upload_use_cinder_backend = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_upload_use_internal_tenant = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_volume_cache_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_volume_cache_max_count = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] image_volume_cache_max_size_gb = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] init_host_max_objects_retrieval = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] instance_format = [instance: %(uuid)s] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iscsi_target_flags = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iscsi_write_cache = on {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iser_helper = tgtadm {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iser_ip_address = 192.168.122.196 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iser_port = 3260 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_color = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_config_append = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_dir = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_options = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_rotate_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_rotate_interval_type = days {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] log_rotation_type = none {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] max_age = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] max_logfile_count = 30 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] max_logfile_size_mb = 200 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] max_over_subscription_ratio = 20.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] message_reap_interval = 86400 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] message_ttl = 2592000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] migration_create_volume_timeout_secs = 300 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] monkey_patch = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] monkey_patch_modules = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] my_ip = 192.168.122.196 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] no_snapshot_gb_quota = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] num_iser_scan_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] num_shell_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] num_volume_device_scan_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] nvmeof_conn_info_version = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] nvmet_ns_id = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] nvmet_port_id = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_max_limit = 1000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_ext_list = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_listen_port = 8776 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_use_ssl = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] osapi_volume_workers = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] per_volume_size_limit = -1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] periodic_fuzzy_delay = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] periodic_interval = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] public_endpoint = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] publish_errors = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_backup_gigabytes = 1000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_backups = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_gigabytes = 1000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_groups = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_snapshots = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] quota_volumes = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] rate_limit_burst = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] rate_limit_except_level = CRITICAL {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] rate_limit_interval = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] reinit_driver_count = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] replication_device = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] report_discard_supported = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] report_interval = 120 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] reservation_clean_interval = 86400 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] reservation_expire = 86400 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] reserved_image_namespaces = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] reserved_percentage = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] rpc_response_timeout = 120 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] run_external_periodic_tasks = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] scst_target_driver = iscsi {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] scst_target_iqn_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_down_time = 720 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] shell_completion = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] snapshot_name_template = snapshot-%s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] split_loggers = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] state_path = /opt/stack/data/cinder {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81787]: INFO cinder.volume.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] storage_availability_zone = nova {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] storage_protocol = iSCSI {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] syslog_log_facility = LOG_USER {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_helper = lioadm {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.remotefs [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81787) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_ip_address = 192.168.122.196 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_port = 3260 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_protocol = iscsi {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] target_secondary_ip_addresses = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] trace_flags = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] transport_url = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] until_refresh = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_chap_auth = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_default_quota_class = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_journal = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_json = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_multipath_for_image_xfer = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_stderr = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] use_syslog = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] verify_glance_signatures = enabled {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_api_class = cinder.volume.api.API {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_backend_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_clear = zero {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_clear_ionice = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_clear_size = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_copy_bps_limit = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_dd_blocksize = 1M {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_name_template = volume-%s {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_service_inithost_offload = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volume_usage_audit_period = month {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] zoning_mode = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_concurrency.disable_process_locking = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.admin_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.admin_token = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.admin_user = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_port = 35357 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_protocol = https {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_section = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_type = password {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_uri = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.auth_version = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.cache = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.identity_uri = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.include_service_catalog = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.interface = public {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_password = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcache_username = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.region_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.service_type = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.backend = dogpile.cache.null {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.backend_argument = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.backend_expiration_time = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.config_prefix = cache.oslo {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.debug_cache_backend = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.enable_retry_client = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.enable_socket_keepalive = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.enforce_fips_mode = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.expiration_time = 600 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.hashclient_retry_attempts = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_dead_retry = 300 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_pool_maxsize = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_sasl_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.proxies = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.redis_db = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.redis_server = localhost:6379 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.retry_attempts = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.retry_delay = 0.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.socket_keepalive_count = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.socket_keepalive_idle = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.socket_keepalive_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.socket_timeout = 1.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.tls_allowed_ciphers = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.tls_cafile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.tls_certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.tls_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.tls_keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cache.username = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] coordination.backend_url = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.asyncio_connection = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.asyncio_slave_connection = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.backend = sqlalchemy {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.connection = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.connection_debug = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.connection_parameters = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.connection_recycle_time = 3600 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.connection_trace = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.db_inc_retry_interval = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.db_max_retries = 20 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.db_max_retry_interval = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.db_retry_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.max_overflow = 50 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.max_pool_size = 5 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.max_retries = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.mysql_wsrep_sync_wait = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.pool_timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.retry_interval = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.slave_connection = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.sqlite_synchronous = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.synchronous_reader = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] database.use_db_reconnect = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.connection_string = messaging:// {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.es_doc_type = notification {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.es_scroll_size = 10000 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.es_scroll_time = 2m {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.filter_error_trace = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.hmac_keys = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.sentinel_service_name = mymaster {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.socket_timeout = 0.1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.trace_requests = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler.trace_sqlalchemy = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler_jaeger.process_tags = {} {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler_jaeger.service_name_prefix = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] profiler_otlp.service_name_prefix = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.enforce_new_defaults = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: WARNING oslo_config.cfg [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.enforce_scope = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.policy_default_rule = default {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.policy_file = policy.yaml {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.group = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.helper_command = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] privsep_osbrick.user = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81787) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.group = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81787]: WARNING cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.helper_command = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81787]: WARNING cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] cinder_sys_admin.user = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.auth_section = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Running cmd (subprocess): mount.quobyte {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.auth_type = password {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.cafile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.collect_timing = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.send_service_user_token = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.split_loggers = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] service_user.timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.auth_section = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.auth_type = password {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.collect_timing = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.region_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.split_loggers = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] glance.timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.backend_availability_zone = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.chap_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.chap_username = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.disk_geometry = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_client_cert = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_client_cert_key = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_data_namespace = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.driver_use_ssl = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.extra_capabilities = {} {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.filter_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.goodness_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iscsi_target_flags = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iscsi_write_cache = on {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iser_helper = tgtadm {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iser_port = 3260 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_host = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_login = admin {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_mount_options = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_private_key = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_share_path = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.num_shell_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.quobyte_volume_url = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.replication_device = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.report_discard_supported = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.reserved_percentage = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_helper = tgtadm {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_port = 3260 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_protocol = iscsi {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.trace_flags = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.unique_fqdn_network = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.use_chap_auth = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_backend_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_clear = zero {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_clear_ionice = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_clear_size = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_reports.file_event_handler = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_reports.log_dir = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.backend_availability_zone = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.backend_host = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.chap_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.chap_username = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.chiscsi_conf = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.disk_geometry = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_client_cert = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_data_namespace = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.driver_use_ssl = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.extra_capabilities = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.filter_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.goodness_function = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iser_helper = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iser_ip_address = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iser_port = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.iser_target_prefix = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_host = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_login = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_mount_options = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_password = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_private_key = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_share_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_ssh_port = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.num_shell_tries = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.nvmet_port_id = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.replication_device = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.report_discard_supported = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.reserved_percentage = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.scst_target_driver = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.storage_protocol = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_helper = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_ip_address = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_port = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_prefix = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_protocol = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.trace_flags = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.use_chap_auth = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_clear = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_clear_size = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] QuobyteHD.volumes_dir = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_notifications.driver = [] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_notifications.retry = -1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] key_manager.fixed_key = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.barbican_api_version = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.barbican_endpoint = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.barbican_endpoint_type = public {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.barbican_region_name = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.cafile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.collect_timing = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.number_of_retries = 60 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.retry_delay = 1 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.send_service_user_token = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.split_loggers = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.verify_ssl = True {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican.verify_ssl_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.auth_section = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.auth_type = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.cafile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.certfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.collect_timing = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.insecure = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.keyfile = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.split_loggers = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] barbican_service_user.timeout = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.approle_role_id = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.approle_secret_id = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.kv_mountpoint = secret {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.kv_path = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.kv_version = 2 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.namespace = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.root_token_id = **** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.ssl_ca_crt_file = None {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.timeout = 60.0 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.use_ssl = False {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:46 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] ******************************************************************************** {{(pid=81672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 15:47:46 devstack quobyte-client[81791]: Reading configuration file: /etc/quobyte/client.cfg Apr 08 15:47:46 devstack quobyte-client[81791]: Invalid parameters found, error: missing mount point. Apr 08 15:47:46 devstack quobyte-client[81791]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 08 15:47:46 devstack quobyte-client[81791]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=81787) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:47:46 devstack cinder-volume[81787]: INFO cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 ... Apr 08 15:47:46 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 -c /etc/quobyte/client-cinder.cfg {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:46 devstack sudo[81792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 -c /etc/quobyte/client-cinder.cfg Apr 08 15:47:46 devstack sudo[81792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:47:47 devstack sudo[81792]: pam_unix(sudo:session): session closed for user root Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.494s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:47 devstack cinder-volume[81787]: INFO cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 succeeded Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=81787) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.518s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:47 devstack sudo[81861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:47:47 devstack sudo[81861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:47:47 devstack sudo[81861]: pam_unix(sudo:session): session closed for user root Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.384s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:47 devstack cinder-volume[81787]: INFO cinder.volume.driver [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Driver hasn't implemented _init_vendor_properties() Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.volume.driver [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81787) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_db.sqlalchemy.engines [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81787) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG dbcounter [-] [81787] Writer thread running {{(pid=81787) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.db.sqlalchemy.api [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Building query based on filter {{(pid=81787) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.image.image_utils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81787) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 15:47:47 devstack cinder-volume[81787]: INFO cinder.keymgr.migration [None req-fb5991ab-967b-4cbe-aa01-2124bf227a06 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=81787) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=81787) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:47:47 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:47 devstack sudo[81864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:47:47 devstack sudo[81864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:47:48 devstack sudo[81864]: pam_unix(sudo:session): session closed for user root Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.398s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG cinder.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Notifying Schedulers of capabilities ... {{(pid=81787) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:47:48 devstack cinder-volume[81787]: INFO cinder.volume.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Driver initialization completed successfully. Apr 08 15:47:48 devstack cinder-volume[81787]: INFO cinder.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Initiating service 3 cleanup Apr 08 15:47:48 devstack cinder-volume[81787]: INFO cinder.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Service 3 cleanup completed. Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG cinder.service [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Creating RPC server for service cinder-volume {{(pid=81787) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG cinder.service [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81787) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 15:47:48 devstack cinder-volume[81787]: INFO cinder.volume.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=81787) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=81787) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:48 devstack sudo[81869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:47:48 devstack sudo[81869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:47:48 devstack cinder-volume[72433]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Acquiring lock "singleton_lock" {{(pid=72433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:48 devstack cinder-volume[72433]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Acquired lock "singleton_lock" {{(pid=72433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:48 devstack cinder-volume[72433]: DEBUG oslo_concurrency.lockutils [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Releasing lock "singleton_lock" {{(pid=72433) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:48 devstack cinder-volume[72433]: WARNING amqp [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 15:47:48 devstack cinder-volume[72433]: WARNING amqp [None req-ba0459f5-c7da-4861-80dd-224677c2a47e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 15:47:48 devstack sudo[81869]: pam_unix(sudo:session): session closed for user root Apr 08 15:47:48 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.473s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:48 devstack cinder-volume[81787]: INFO cinder.volume.manager [None req-85cfd67b-5de2-4344-bd5b-581d2ee0605a None None] Driver post RPC initialization completed successfully. Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=81787) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG cinder.volume.drivers.quobyte [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=81787) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81787) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:47:51 devstack sudo[81935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:47:51 devstack sudo[81935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:47:51 devstack sudo[81935]: pam_unix(sudo:session): session closed for user root Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG oslo_concurrency.processutils [None req-21e28d77-3087-4569-be5b-b605261f218c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.381s {{(pid=81787) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:47:51 devstack cinder-volume[81787]: DEBUG cinder.manager [None req-21e28d77-3087-4569-be5b-b605261f218c None None] Notifying Schedulers of capabilities ... {{(pid=81787) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:47:55 devstack cinder-volume[81672]: INFO oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Caught SIGTERM, stopping children Apr 08 15:47:55 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Acquiring lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:55 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Acquired lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:55 devstack cinder-volume[81672]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Releasing lock "singleton_lock" {{(pid=81672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:55 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Stop services. {{(pid=81672) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 08 15:47:55 devstack cinder-volume[81672]: DEBUG oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Killing children. {{(pid=81672) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 08 15:47:55 devstack cinder-volume[81672]: INFO oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Waiting on 1 children to exit Apr 08 15:47:56 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Acquiring lock "singleton_lock" {{(pid=81787) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:56 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Acquired lock "singleton_lock" {{(pid=81787) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:56 devstack cinder-volume[81787]: DEBUG oslo_concurrency.lockutils [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Releasing lock "singleton_lock" {{(pid=81787) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:56 devstack cinder-volume[81787]: WARNING amqp [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 15:47:56 devstack cinder-volume[81787]: WARNING amqp [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 15:47:56 devstack cinder-volume[81672]: INFO oslo_service.backend._eventlet.service [None req-abfc6f15-9531-40c9-9a1f-b15f000df969 None None] Child 81787 exited with status 0 Apr 08 15:47:56 devstack cinder-volume[82011]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 15:47:56 devstack cinder-volume[82011]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 15:47:56 devstack cinder-volume[82011]: we strongly recommend against using it for new projects. Apr 08 15:47:56 devstack cinder-volume[82011]: If you are already using Eventlet, we recommend migrating to a different Apr 08 15:47:56 devstack cinder-volume[82011]: framework. For more detail see Apr 08 15:47:56 devstack cinder-volume[82011]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 15:47:56 devstack cinder-volume[82011]: import eventlet # noqa Apr 08 15:47:58 devstack cinder-volume[82011]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 15:47:58 devstack cinder-volume[82011]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 15:47:58 devstack cinder-volume[82011]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82011) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 15:47:59 devstack cinder-volume[82011]: INFO dbcounter [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Registered counter for database cinder Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG dbcounter [-] [82011] Writer thread running {{(pid=82011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:47:59 devstack cinder-volume[82011]: INFO cinder.rpc [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 15:47:59 devstack cinder-volume[82011]: INFO cinder.rpc [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:59 devstack cinder-volume[82011]: INFO cinder.volume.manager [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Determined volume DB was empty at startup. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG cinder.volume.manager [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82011) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 15:47:59 devstack cinder-volume[82011]: WARNING stevedore.named [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 15:47:59 devstack cinder-volume[82011]: WARNING castellan.key_manager [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:47:59 devstack cinder-volume[82011]: WARNING cinder.keymgr.conf_key_mgr [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 15:47:59 devstack cinder-volume[82011]: INFO cinder.volume.manager [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_db.sqlalchemy.engines [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:47:59 devstack cinder-volume[82011]: INFO oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Starting 1 workers Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Started child 82216 {{(pid=82011) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Full set of CONF: {{(pid=82011) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] ******************************************************************************** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Configuration options gathered from: {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] ================================================================================ {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] allow_availability_zone_fallback = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] allow_compression_on_image_upload = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] allowed_direct_url_schemes = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] api_rate_limit = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] auth_strategy = keystone {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_availability_zone = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_host = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_stats_polling_interval = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backup_api_class = cinder.backup.api.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backup_name_template = backup-%s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backup_use_same_host = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backup_use_temp_snapshot = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] chap_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] chap_username = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82216]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_internal_tenant_project_id = 74487bcbf623420fb29c39f784b7b0b7 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_internal_tenant_user_id = beb7d6c657e54583b80e1691cab545b5 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cluster = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] compression_format = gzip {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] compute_api_class = cinder.compute.nova.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] config_dir = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] config_source = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] control_exchange = openstack {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] debug = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] default_availability_zone = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] default_group_type = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] default_volume_type = QuobyteHD {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] disk_geometry = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_client_cert = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_client_cert_key = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_data_namespace = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_ssl_cert_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_ssl_cert_verify = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] driver_use_ssl = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] enable_new_services = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] enable_unsupported_driver = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] enabled_backends = ['QuobyteHD'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] enforce_multipath_for_image_xfer = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] filter_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_api_insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_api_ssl_compression = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_ca_certificates_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_catalog_info = image:glance:publicURL {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_num_retries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance_request_timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] goodness_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] graceful_shutdown_timeout = 5 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] group_api_class = cinder.group.api.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] host = devstack {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_compress_on_upload = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_conversion_address_space_limit = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_conversion_cpu_limit = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_conversion_disable = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_upload_use_cinder_backend = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_upload_use_internal_tenant = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_volume_cache_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_volume_cache_max_count = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] image_volume_cache_max_size_gb = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] init_host_max_objects_retrieval = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] instance_format = [instance: %(uuid)s] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iscsi_target_flags = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iscsi_write_cache = on {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iser_helper = tgtadm {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iser_ip_address = 192.168.122.196 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iser_port = 3260 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_color = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_config_append = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_dir = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_options = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_rotate_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_rotate_interval_type = days {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] log_rotation_type = none {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] max_age = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] max_logfile_count = 30 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] max_logfile_size_mb = 200 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] max_over_subscription_ratio = 20.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] message_reap_interval = 86400 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] message_ttl = 2592000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 08 15:47:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82216) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] migration_create_volume_timeout_secs = 300 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] monkey_patch = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] monkey_patch_modules = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] my_ip = 192.168.122.196 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] no_snapshot_gb_quota = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] num_iser_scan_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] num_shell_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] num_volume_device_scan_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] nvmeof_conn_info_version = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] nvmet_ns_id = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] nvmet_port_id = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_max_limit = 1000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_ext_list = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_listen_port = 8776 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_use_ssl = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] osapi_volume_workers = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] per_volume_size_limit = -1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] periodic_fuzzy_delay = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] periodic_interval = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] public_endpoint = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] publish_errors = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_backup_gigabytes = 1000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_backups = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_gigabytes = 1000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_groups = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_snapshots = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] quota_volumes = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] rate_limit_burst = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] rate_limit_except_level = CRITICAL {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] rate_limit_interval = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] reinit_driver_count = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] replication_device = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] report_discard_supported = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] report_interval = 120 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] reservation_clean_interval = 86400 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] reservation_expire = 86400 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] reserved_image_namespaces = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] reserved_percentage = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] rpc_response_timeout = 120 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] run_external_periodic_tasks = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] scst_target_driver = iscsi {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] scst_target_iqn_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_down_time = 720 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] shell_completion = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] snapshot_name_template = snapshot-%s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] split_loggers = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] state_path = /opt/stack/data/cinder {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] storage_availability_zone = nova {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] storage_protocol = iSCSI {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] syslog_log_facility = LOG_USER {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_helper = lioadm {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_ip_address = 192.168.122.196 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_port = 3260 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_protocol = iscsi {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] target_secondary_ip_addresses = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] trace_flags = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] transport_url = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] until_refresh = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_chap_auth = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_default_quota_class = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_journal = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_json = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_multipath_for_image_xfer = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_stderr = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] use_syslog = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] verify_glance_signatures = enabled {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_api_class = cinder.volume.api.API {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_backend_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_clear = zero {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_clear_ionice = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_clear_size = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack quobyte-client[82224]: Reading configuration file: /etc/quobyte/client.cfg Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_copy_bps_limit = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_dd_blocksize = 1M {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_name_template = volume-%s {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_service_inithost_offload = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack quobyte-client[82224]: Invalid parameters found, error: missing mount point. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volume_usage_audit_period = month {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] zoning_mode = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack quobyte-client[82224]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_concurrency.disable_process_locking = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack quobyte-client[82224]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.admin_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.admin_token = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.admin_user = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_port = 35357 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_protocol = https {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_section = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_type = password {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_uri = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.auth_version = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.cache = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.identity_uri = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.include_service_catalog = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.interface = public {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_password = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcache_username = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.region_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.service_type = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.backend = dogpile.cache.null {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.backend_argument = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:47:59 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.backend_expiration_time = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.config_prefix = cache.oslo {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.debug_cache_backend = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.enable_retry_client = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.enable_socket_keepalive = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.enforce_fips_mode = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.expiration_time = 600 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.hashclient_retry_attempts = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_dead_retry = 300 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_pool_maxsize = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack sudo[82225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_sasl_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.proxies = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.redis_db = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack sudo[82225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.redis_server = localhost:6379 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.retry_attempts = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.retry_delay = 0.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.socket_keepalive_count = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.socket_keepalive_idle = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.socket_keepalive_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.socket_timeout = 1.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.tls_allowed_ciphers = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.tls_cafile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.tls_certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.tls_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.tls_keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cache.username = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] coordination.backend_url = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.asyncio_connection = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.asyncio_slave_connection = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.backend = sqlalchemy {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.connection = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.connection_debug = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.connection_parameters = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.connection_recycle_time = 3600 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.connection_trace = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.db_inc_retry_interval = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82216) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 08 15:48:00 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 08 15:48:00 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.db_max_retries = 20 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.db_max_retry_interval = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.db_retry_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.max_overflow = 50 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.max_pool_size = 5 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.max_retries = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.mysql_wsrep_sync_wait = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.pool_timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.retry_interval = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.slave_connection = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.sqlite_synchronous = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.synchronous_reader = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] database.use_db_reconnect = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.connection_string = messaging:// {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.es_doc_type = notification {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.es_scroll_size = 10000 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.es_scroll_time = 2m {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.filter_error_trace = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.hmac_keys = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.sentinel_service_name = mymaster {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.socket_timeout = 0.1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.trace_requests = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler.trace_sqlalchemy = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler_jaeger.process_tags = {} {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Running cmd (subprocess): mount.quobyte {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler_jaeger.service_name_prefix = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] profiler_otlp.service_name_prefix = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.enforce_new_defaults = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: WARNING oslo_config.cfg [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.enforce_scope = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.policy_default_rule = default {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.policy_file = policy.yaml {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.group = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.helper_command = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] privsep_osbrick.user = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.group = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.helper_command = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] cinder_sys_admin.user = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.auth_section = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.auth_type = password {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.cafile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.collect_timing = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.send_service_user_token = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.split_loggers = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] service_user.timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.auth_section = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.auth_type = password {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.collect_timing = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.region_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.split_loggers = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] glance.timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.backend_availability_zone = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.chap_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.chap_username = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.disk_geometry = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_client_cert = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_client_cert_key = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_data_namespace = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.driver_use_ssl = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.extra_capabilities = {} {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.filter_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.goodness_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iscsi_target_flags = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iscsi_write_cache = on {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iser_helper = tgtadm {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iser_port = 3260 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_host = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_login = admin {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_mount_options = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_private_key = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_share_path = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.num_shell_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.quobyte_volume_url = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.replication_device = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.report_discard_supported = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.reserved_percentage = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_helper = tgtadm {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_port = 3260 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_protocol = iscsi {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.trace_flags = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.unique_fqdn_network = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.use_chap_auth = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_backend_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_clear = zero {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_clear_ionice = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_clear_size = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_reports.file_event_handler = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_reports.log_dir = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.backend_availability_zone = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.backend_host = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.chap_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.chap_username = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.chiscsi_conf = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.disk_geometry = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_client_cert = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_data_namespace = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.driver_use_ssl = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.extra_capabilities = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.filter_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.goodness_function = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iser_helper = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iser_ip_address = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iser_port = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.iser_target_prefix = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_host = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_login = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_mount_options = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_password = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_private_key = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_share_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_ssh_port = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.num_shell_tries = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.nvmet_port_id = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.replication_device = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.report_discard_supported = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.reserved_percentage = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.scst_target_driver = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.storage_protocol = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_helper = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_ip_address = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_port = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_prefix = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_protocol = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.trace_flags = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.use_chap_auth = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_clear = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_clear_size = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] QuobyteHD.volumes_dir = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_notifications.driver = [] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_notifications.retry = -1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] key_manager.fixed_key = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.barbican_api_version = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.barbican_endpoint = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.barbican_endpoint_type = public {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.barbican_region_name = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.cafile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.collect_timing = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.number_of_retries = 60 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.retry_delay = 1 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.send_service_user_token = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.split_loggers = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.verify_ssl = True {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican.verify_ssl_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.auth_section = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.auth_type = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.cafile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.certfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.collect_timing = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.insecure = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.keyfile = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.split_loggers = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] barbican_service_user.timeout = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.approle_role_id = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.approle_secret_id = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.kv_mountpoint = secret {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.kv_path = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.kv_version = 2 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.namespace = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.root_token_id = **** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.ssl_ca_crt_file = None {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.timeout = 60.0 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.use_ssl = False {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 15:48:00 devstack cinder-volume[82011]: DEBUG oslo_service.backend._eventlet.service [None req-5bac8543-19f2-4ecc-af81-d80e021d5e00 None None] ******************************************************************************** {{(pid=82011) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 15:48:00 devstack sudo[82225]: pam_unix(sudo:session): session closed for user root Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.616s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:48:00 devstack cinder-volume[82216]: INFO cinder.volume.driver [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Driver hasn't implemented _init_vendor_properties() Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.driver [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82216) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_db.sqlalchemy.engines [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writer thread running {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.db.sqlalchemy.api [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Building query based on filter {{(pid=82216) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82216) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:48:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:48:00 devstack cinder-volume[82216]: INFO cinder.keymgr.migration [None req-de12abcb-baf9-4ab5-b013-41b1223806d5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 15:48:00 devstack sudo[82254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:48:00 devstack sudo[82254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:48:01 devstack sudo[82254]: pam_unix(sudo:session): session closed for user root Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.414s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:48:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Driver initialization completed successfully. Apr 08 15:48:01 devstack cinder-volume[82216]: INFO cinder.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Initiating service 3 cleanup Apr 08 15:48:01 devstack cinder-volume[82216]: INFO cinder.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Service 3 cleanup completed. Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG cinder.service [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Creating RPC server for service cinder-volume {{(pid=82216) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG cinder.service [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82216) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 15:48:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:48:01 devstack sudo[82259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:48:01 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:48:01 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root Apr 08 15:48:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.396s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:48:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0c225831-b293-4445-bfc8-3d05871b52d3 None None] Driver post RPC initialization completed successfully. Apr 08 15:48:09 devstack cinder-volume[82011]: DEBUG dbcounter [-] [82011] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82011) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:48:11 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=3 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:48:11 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:48:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-33fe115a-fc38-4be9-ae8e-23bd0e50e57e tempest-BackendsCapabilitiesAdminTestsJSON-850831698 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82216) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 08 15:48:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c07ae59b-5bcf-46dd-bc4e-f8b688be8464 tempest-BackendsCapabilitiesAdminTestsJSON-850831698 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82216) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Flow 'volume_create_manager' (447f75d5-54d4-47c0-a57f-4ccaa966ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ec8db1-9b33-4075-a52f-5f9c5bfed057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ec8db1-9b33-4075-a52f-5f9c5bfed057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1648646219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0809e0-6b9e-43c6-a234-d53430e94858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d70a1380ed4dd6a83dae72fc191ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:02Z,use_quota=True,user_id='f02eeac313754a6d873f5912b297ac53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f611a4e-7a6c-40d9-acb2-ec1d89435771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f611a4e-7a6c-40d9-acb2-ec1d89435771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4028e3-d384-42ff-842e-55a865f4ed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4028e3-d384-42ff-842e-55a865f4ed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0809e0-6b9e-43c6-a234-d53430e94858', 'volume_name': 'volume-3a0809e0-6b9e-43c6-a234-d53430e94858', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da401cf-6c67-4c29-a837-61fc6b92dd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da401cf-6c67-4c29-a837-61fc6b92dd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0486c8-e961-41b2-8a31-a7c34912948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Volume 3a0809e0-6b9e-43c6-a234-d53430e94858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0809e0-6b9e-43c6-a234-d53430e94858', 'volume_size': 1} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1648646219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0809e0-6b9e-43c6-a234-d53430e94858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d70a1380ed4dd6a83dae72fc191ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:02Z,use_quota=True,user_id='f02eeac313754a6d873f5912b297ac53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Creating volume 3a0809e0-6b9e-43c6-a234-d53430e94858 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:01 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:01 devstack sudo[82755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 1073741824 Apr 08 15:49:01 devstack sudo[82755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Flow 'volume_create_manager' (95b95829-d06b-44f4-bde3-0ae9a147d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99acce-72b9-468c-9a80-007124a92bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99acce-72b9-468c-9a80-007124a92bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-463971211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd6c6c7-41ed-40c2-909d-5e6579973c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548bda4cea264ed3832c7413b80b5694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:02Z,use_quota=True,user_id='e2cbe37ec84a4c4d90900273dd3f7d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7669128d-80e6-411b-a8e5-0309214ceba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7669128d-80e6-411b-a8e5-0309214ceba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dbd0d3-82c3-4d7b-9e9c-9e8d8a3fe8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dbd0d3-82c3-4d7b-9e9c-9e8d8a3fe8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd6c6c7-41ed-40c2-909d-5e6579973c5e', 'volume_name': 'volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bec3ae7-3706-4484-ab5f-5e14c06946d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bec3ae7-3706-4484-ab5f-5e14c06946d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3df4343-56c1-4d58-8d62-8f829ced8f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Volume 5bd6c6c7-41ed-40c2-909d-5e6579973c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e', 'volume_size': 1} Apr 08 15:49:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:03 devstack sudo[82755]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 1073741824" returned: 0 in 1.097s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:03 devstack sudo[83072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 Apr 08 15:49:03 devstack sudo[83072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:03 devstack sudo[83072]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858" returned: 0 in 0.857s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-463971211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd6c6c7-41ed-40c2-909d-5e6579973c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548bda4cea264ed3832c7413b80b5694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:02Z,use_quota=True,user_id='e2cbe37ec84a4c4d90900273dd3f7d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Creating volume 5bd6c6c7-41ed-40c2-909d-5e6579973c5e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:03 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0486c8-e961-41b2-8a31-a7c34912948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0809e0-6b9e-43c6-a234-d53430e94858', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:03 devstack sudo[83076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e 1073741824 Apr 08 15:49:03 devstack sudo[83076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac1a372-2c4b-4dfc-9b32-0cab83201cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Volume volume-3a0809e0-6b9e-43c6-a234-d53430e94858 (3a0809e0-6b9e-43c6-a234-d53430e94858): created successfully Apr 08 15:49:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac1a372-2c4b-4dfc-9b32-0cab83201cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Flow 'volume_create_manager' (447f75d5-54d4-47c0-a57f-4ccaa966ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-77014766-2d60-4fb8-976a-aa3e7eeebbd5 tempest-DeleteServersTestJSON-445347885 None] Created volume successfully. Apr 08 15:49:05 devstack sudo[83076]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e 1073741824" returned: 0 in 1.315s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:05 devstack sudo[83088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e Apr 08 15:49:05 devstack sudo[83088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1b881d12-9fee-4a98-830b-e07f144849da tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1543976528: creating Apr 08 15:49:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1b881d12-9fee-4a98-830b-e07f144849da tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1543976528: created successfully Apr 08 15:49:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1b881d12-9fee-4a98-830b-e07f144849da tempest-GroupSnapshotsTest-114372246 None] Create group completed successfully. Apr 08 15:49:05 devstack sudo[83088]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" returned: 0 in 0.675s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3df4343-56c1-4d58-8d62-8f829ced8f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0adb8-d6bb-4357-9a5f-7b3588576578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:06 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Volume volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e (5bd6c6c7-41ed-40c2-909d-5e6579973c5e): created successfully Apr 08 15:49:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0adb8-d6bb-4357-9a5f-7b3588576578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Flow 'volume_create_manager' (95b95829-d06b-44f4-bde3-0ae9a147d426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-21e80296-759a-4fa3-8b8b-43c5fd53a034 tempest-VolumesAdminNegativeTest-1550608581 None] Created volume successfully. Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (565ed1a0-10dc-40d7-a1b2-603d73fb90f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e5944c-6a80-49e1-8ada-08d0752bdf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e5944c-6a80-49e1-8ada-08d0752bdf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468699961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d421c633-b799-4a46-a656-35eb887bbea5,host='devstack@QuobyteHD#QuobyteHD',id=a278ac99-c7fe-4a60-aebc-5212c3a9ff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:07Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ffca8c-8c5d-43ed-817e-6816d5d31e25),volume_type_id=e0ffca8c-8c5d-43ed-817e-6816d5d31e25)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e994f4b-9d21-4681-9bad-ed509eed6e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e994f4b-9d21-4681-9bad-ed509eed6e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291afc8b-c849-457d-85db-9aa3adafa4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291afc8b-c849-457d-85db-9aa3adafa4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a278ac99-c7fe-4a60-aebc-5212c3a9ff87', 'volume_name': 'volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fb3c7c-5f55-435e-9459-98a5481cf7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fb3c7c-5f55-435e-9459-98a5481cf7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82da5c7-d4a5-4fa6-801f-ef5e572918a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Volume a278ac99-c7fe-4a60-aebc-5212c3a9ff87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87', 'volume_size': 1} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d421c633-b799-4a46-a656-35eb887bbea5,created_at=2026-04-08T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468699961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d421c633-b799-4a46-a656-35eb887bbea5,host='devstack@QuobyteHD#QuobyteHD',id=a278ac99-c7fe-4a60-aebc-5212c3a9ff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:07Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0ffca8c-8c5d-43ed-817e-6816d5d31e25),volume_type_id=e0ffca8c-8c5d-43ed-817e-6816d5d31e25)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Creating volume a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:07 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:07 devstack sudo[83093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 1073741824 Apr 08 15:49:07 devstack sudo[83093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Acquiring lock "cinder-5bd6c6c7-41ed-40c2-909d-5e6579973c5e-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "cinder-5bd6c6c7-41ed-40c2-909d-5e6579973c5e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Acquiring lock "cinder-quobyte-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "cinder-quobyte-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:08 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyxk9souj/privsep.sock'] Apr 08 15:49:08 devstack sudo[83101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyxk9souj/privsep.sock Apr 08 15:49:08 devstack sudo[83101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 08 15:49:09 devstack sudo[83093]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 1073741824" returned: 0 in 1.852s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:09 devstack sudo[83122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:09 devstack sudo[83122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 15:49:09 devstack cinder-volume[82216]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 08 15:49:10 devstack sudo[83101]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:10 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Spawned new privsep daemon via rootwrap Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Accepted privsep connection to /tmp/tmpyxk9souj/privsep.sock {{(pid=82216) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 08 15:49:10 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 08 15:49:10 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 08 15:49:10 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 08 15:49:10 devstack cinder-volume[82216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83125 Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d559a0-81c9-46ca-af49-bde9815958f2]: (2,) {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f24ee3-520b-476b-81b4-80ffe754774f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:10 devstack sudo[83122]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 1.028s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] <== create_volume: return (2928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.930s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82da5c7-d4a5-4fa6-801f-ef5e572918a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2fe2d3-8441-4d82-a654-a7681f167491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:10 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Volume volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 (a278ac99-c7fe-4a60-aebc-5212c3a9ff87): created successfully Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2fe2d3-8441-4d82-a654-a7681f167491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (565ed1a0-10dc-40d7-a1b2-603d73fb90f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-65952658-d381-4e36-a484-7f872384653e tempest-GroupSnapshotsTest-114372246 None] Created volume successfully. Apr 08 15:49:10 devstack sudo[83129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e Apr 08 15:49:10 devstack sudo[83129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] GroupSnapshot 232aebf8-886e-456e-a991-87e2f8ff1319: creating. Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Group snapshot 232aebf8-886e-456e-a991-87e2f8ff1319: creating. {{(pid=82216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Creating offline snapshot c8a64251-a09f-46bf-bc76-84900c43c5d1 of volume a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:49:11 devstack cinder-volume[82216]: WARNING py.warnings [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 08 15:49:11 devstack cinder-volume[82216]: .first() Apr 08 15:49:11 devstack cinder-volume[82216]: Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b846c31-cda7-4368-9907-04d434f40d3f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:11 devstack sudo[83144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:11 devstack sudo[83144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:11 devstack sudo[83129]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" returned: 0 in 1.295s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:11 devstack sudo[83146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e Apr 08 15:49:11 devstack sudo[83146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:12 devstack sudo[83144]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.743s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:12 devstack sudo[83146]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:12 devstack sudo[83155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 1G Apr 08 15:49:12 devstack sudo[83155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" returned: 0 in 0.605s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "cinder-quobyte-5bd6c6c7-41ed-40c2-909d-5e6579973c5e" released by "delete_volume" :: held 4.010s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:12 devstack cinder-volume[82216]: WARNING cinder.quota [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:12 devstack cinder-volume[82216]: WARNING cinder.quota [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Created reservations ['a20cddc1-39f2-4213-81f5-fb13f325a5a3', '5d81c613-4540-44db-a556-447fd01e163b', '17b1c48e-c0e6-449f-bbd9-df6c4233cf5a', '4beb0bbc-4c69-4778-8997-869ea13e8b13'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:12 devstack sudo[83157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:12 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:13 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.692s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Deleted volume successfully. Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a5d59b6e-1bbd-4567-8765-8ab2795650b4 tempest-VolumesAdminNegativeTest-1550608581 None] Lock "cinder-5bd6c6c7-41ed-40c2-909d-5e6579973c5e-delete_volume" released by "delete_volume" :: held 5.072s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:13 devstack sudo[83155]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 1G" returned: 0 in 1.043s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:13 devstack sudo[83164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:13 devstack sudo[83164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:13 devstack sudo[83164]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:13 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:13 devstack sudo[83184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:13 devstack sudo[83184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:15 devstack sudo[83184]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 1.236s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:15 devstack sudo[83224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info Apr 08 15:49:15 devstack sudo[83224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:15 devstack sudo[83224]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info" returned: 0 in 0.533s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:15 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:15 devstack sudo[83229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info Apr 08 15:49:15 devstack sudo[83229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:16 devstack sudo[83229]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.info" returned: 0 in 0.890s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.179s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.962s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:16 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97ebe4-d479-4474-9f05-040cc2978cf9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:16 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-90633456-bcc9-4b2d-a7fa-51c9d7ddc75b tempest-GroupSnapshotsTest-114372246 None] group_snapshot 232aebf8-886e-456e-a991-87e2f8ff1319: created successfully Apr 08 15:49:16 devstack sudo[83234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 Apr 08 15:49:16 devstack sudo[83234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:17 devstack sudo[83234]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858" returned: 0 in 0.641s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.657s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8', 'name': 'volume-3a0809e0-6b9e-43c6-a234-d53430e94858', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34f212ca-b7b8-4271-8410-67a117173640', 'enforce_multipath': True} {{(pid=82216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 15:49:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-7cadca1c-e70d-4950-905d-05e90da6310c req-409437c3-b24a-4bb1-9bc8-5a669da087be tempest-DeleteServersTestJSON-445347885 None] attachment_update completed successfully. Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1-a59e968d-4200-4a16-9102-46310d0b9543" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1-a59e968d-4200-4a16-9102-46310d0b9543" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Creating volume a59e968d-4200-4a16-9102-46310d0b9543 from snapshot c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] snapshot: c8a64251-a09f-46bf-bc76-84900c43c5d1, volume: a59e968d-4200-4a16-9102-46310d0b9543, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2fdf94-9f26-4a87-b0af-97d7e7c56901]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:19 devstack sudo[83654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:19 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:19 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 0.594s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c81fc3-1bb5-4125-83fd-1c828361c688]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:20 devstack sudo[83661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:20 devstack sudo[83661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:20 devstack sudo[83661]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.880s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:20 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:49:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:20 devstack sudo[83668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 Apr 08 15:49:20 devstack sudo[83668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:21 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:21 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:23 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 2.377s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:24 devstack sudo[83668]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543" returned: 0 in 3.791s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:24 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a474ead-5f84-4c25-895d-42b6b164c69b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:24 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:24 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:25 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.944s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:25 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87, size 1024.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:49:25 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Converted 1024.00 MB image at 270.04 MB/s Apr 08 15:49:25 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:25 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 Apr 08 15:49:25 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Flow 'volume_create_manager' (81c93996-9bc5-4f52-bd67-d06505ab2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0d225-7ecc-4c37-98dc-69300581708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0d225-7ecc-4c37-98dc-69300581708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1889520582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae4028e-69b3-4601-a063-7516bbef3b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b1c2bbd3c4ef6bf79f2ddacf7a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:26Z,use_quota=True,user_id='5c6fce28f41b47b1a39ab7bcd290a8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca652b-3832-4aae-ad30-b1e2a17c4984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca652b-3832-4aae-ad30-b1e2a17c4984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b4762-ef4d-4b6e-9143-c33b8ec2d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b4762-ef4d-4b6e-9143-c33b8ec2d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae4028e-69b3-4601-a063-7516bbef3b60', 'volume_name': 'volume-aae4028e-69b3-4601-a063-7516bbef3b60', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baad089d-6be4-41e6-a91b-7946d051b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baad089d-6be4-41e6-a91b-7946d051b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39d604d-301b-4311-b2d2-7cdb08ab9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Volume aae4028e-69b3-4601-a063-7516bbef3b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae4028e-69b3-4601-a063-7516bbef3b60', 'volume_size': 1} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:26 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543" returned: 0 in 0.940s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" released by "_copy_volume_from_snapshot" :: held 7.252s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1-a59e968d-4200-4a16-9102-46310d0b9543" released by "_create_volume_from_snapshot" :: held 7.291s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.306s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1889520582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae4028e-69b3-4601-a063-7516bbef3b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b1c2bbd3c4ef6bf79f2ddacf7a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:26Z,use_quota=True,user_id='5c6fce28f41b47b1a39ab7bcd290a8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Creating volume aae4028e-69b3-4601-a063-7516bbef3b60 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:26 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 1073741824 Apr 08 15:49:26 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d84a9dc5-12ca-4960-a26a-11a9e86a5f3e tempest-GroupSnapshotsTest-114372246 None] Create group from source-snapshot-232aebf8-886e-456e-a991-87e2f8ff1319 completed successfully. Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c24f1-9541-4ef3-9dc2-988a6eaf12c9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:27 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 1073741824" returned: 0 in 0.858s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:27 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 Apr 08 15:49:27 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:27 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 Apr 08 15:49:27 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:27 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543" returned: 0 in 0.541s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:27 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543 Apr 08 15:49:27 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:27 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39d604d-301b-4311-b2d2-7cdb08ab9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae4028e-69b3-4601-a063-7516bbef3b60', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5289a3d4-004a-48aa-ae42-06ffdca8681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:28 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Volume volume-aae4028e-69b3-4601-a063-7516bbef3b60 (aae4028e-69b3-4601-a063-7516bbef3b60): created successfully Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5289a3d4-004a-48aa-ae42-06ffdca8681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Flow 'volume_create_manager' (81c93996-9bc5-4f52-bd67-d06505ab2522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d66ca1ff-1dc2-41f1-883c-b9bb87263e26 tempest-ServersNegativeTestJSON-59551921 None] Created volume successfully. Apr 08 15:49:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-975a32fa-e372-45b6-aa19-31dd7a9052cc req-0f8ab50f-6aac-4646-9c17-8331180bebe6 tempest-DeleteServersTestJSON-445347885 None] Terminate volume connection completed successfully. Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-975a32fa-e372-45b6-aa19-31dd7a9052cc req-0f8ab50f-6aac-4646-9c17-8331180bebe6 tempest-DeleteServersTestJSON-445347885 None] Deleting attachment 34f212ca-b7b8-4271-8410-67a117173640. {{(pid=82216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 15:49:28 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a59e968d-4200-4a16-9102-46310d0b9543" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a59e968d-4200-4a16-9102-46310d0b9543" released by "delete_volume" :: held 1.105s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['bd12cbd5-1b4e-4040-96cb-44ba025f497c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:28 devstack cinder-volume[82216]: WARNING cinder.quota [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1850633477 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1850633477, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:28 devstack cinder-volume[82216]: WARNING cinder.quota [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1850633477 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1850633477, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['3415ba19-d0b1-47b6-979e-db329fe11020', 'bdcf8f45-8096-4d32-b51d-6fb487ad4d5f', '855a4c5d-caab-4acf-b248-3e3609b0ffbb', 'acac3239-dace-4cf0-9a2d-5562a376a747'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:28 devstack sudo[83799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:28 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:29 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.578s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7d954ee2-e120-4d6c-861c-7b5831248f69 tempest-GroupSnapshotsTest-114372246 None] Delete group completed successfully. Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Flow 'volume_create_manager' (2e5a4fe4-a631-4bc1-9d0f-728ca8cf12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1ed283-8e9a-4d4a-a84f-84a2d4d24056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1ed283-8e9a-4d4a-a84f-84a2d4d24056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1223350739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4512bf-902b-4f12-a8f3-2fa696c91cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b1c2bbd3c4ef6bf79f2ddacf7a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:30Z,use_quota=True,user_id='5c6fce28f41b47b1a39ab7bcd290a8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed20c44-89f3-41bc-8030-e9428487d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed20c44-89f3-41bc-8030-e9428487d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da991c5-9e18-4254-999e-507796a43c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da991c5-9e18-4254-999e-507796a43c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4512bf-902b-4f12-a8f3-2fa696c91cc0', 'volume_name': 'volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e06fc0-4564-445a-8b72-4a1872f59761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e06fc0-4564-445a-8b72-4a1872f59761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef4093a-6a3b-4994-8ff0-d7648d6a3f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:29 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Volume ad4512bf-902b-4f12-a8f3-2fa696c91cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0', 'volume_size': 1} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1223350739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4512bf-902b-4f12-a8f3-2fa696c91cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b1c2bbd3c4ef6bf79f2ddacf7a2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:30Z,use_quota=True,user_id='5c6fce28f41b47b1a39ab7bcd290a8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Creating volume ad4512bf-902b-4f12-a8f3-2fa696c91cc0 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:29 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 232aebf8-886e-456e-a991-87e2f8ff1319: deleting Apr 08 15:49:29 devstack sudo[83805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 1073741824 Apr 08 15:49:29 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 232aebf8-886e-456e-a991-87e2f8ff1319: deleting {{(pid=82216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Deleting offline snapshot c8a64251-a09f-46bf-bc76-84900c43c5d1 of volume a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] snapshot_file for this snap is: volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc0a83-878d-4a30-bdc9-b15d17d9c7bc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:29 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:29 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:30 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac22dc9-88d3-409d-b9dc-625564f3f85f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:30 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 1073741824" returned: 0 in 0.725s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:30 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:30 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:30 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 Apr 08 15:49:30 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:30 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" returned: 0 in 0.500s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef4093a-6a3b-4994-8ff0-d7648d6a3f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:30 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70851713-d75f-4ec3-8df7-4410c5276ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Volume volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 (ad4512bf-902b-4f12-a8f3-2fa696c91cc0): created successfully Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70851713-d75f-4ec3-8df7-4410c5276ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:30 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:30 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Flow 'volume_create_manager' (2e5a4fe4-a631-4bc1-9d0f-728ca8cf12a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-181f5e8c-3afb-4439-8184-aad23d5d5b0b tempest-ServersNegativeTestJSON-59551921 None] Created volume successfully. Apr 08 15:49:31 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 0.503s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:31 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1 Apr 08 15:49:31 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:31 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87.c8a64251-a09f-46bf-bc76-84900c43c5d1" returned: 0 in 0.501s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-c8a64251-a09f-46bf-bc76-84900c43c5d1" released by "_delete_snapshot" :: held 2.160s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" released by "delete_snapshot" :: held 2.173s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:32 devstack cinder-volume[82216]: WARNING cinder.quota [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1850633477 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1850633477, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['a2d5ac06-2232-42dc-beb6-41cb3ede2e8e', '75917b41-406a-411a-8faa-158919d54b58', 'e438ddbd-2dc0-42ce-9460-c355a631b951', '36912bc9-f813-49a9-9590-17d03f5b28fc'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "cinder-ad4512bf-902b-4f12-a8f3-2fa696c91cc0-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:32 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fcc3f1d3-0752-4022-b273-88b87e26c9e6 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 232aebf8-886e-456e-a991-87e2f8ff1319: deleted successfully Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-ad4512bf-902b-4f12-a8f3-2fa696c91cc0-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "cinder-quobyte-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-quobyte-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf31de5-3731-4914-9bd6-3e13b565b7c0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:32 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 Apr 08 15:49:32 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "cinder-3a0809e0-6b9e-43c6-a234-d53430e94858-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "cinder-3a0809e0-6b9e-43c6-a234-d53430e94858-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "cinder-quobyte-3a0809e0-6b9e-43c6-a234-d53430e94858" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "cinder-quobyte-3a0809e0-6b9e-43c6-a234-d53430e94858" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb9cfa8-dc6a-46bb-9878-baba46b82715]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:32 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 Apr 08 15:49:32 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:33 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" returned: 0 in 0.724s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:33 devstack sudo[83847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0 Apr 08 15:49:33 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4406fc13-b4de-4468-91df-b9bbaa79a98e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:33 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:33 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:33 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-quobyte-ad4512bf-902b-4f12-a8f3-2fa696c91cc0" released by "delete_volume" :: held 1.292s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:33 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858" returned: 0 in 0.971s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Created reservations ['ed345a22-6ac7-4d98-a6df-cd5310a3294f', 'fc5f97cd-e297-40f7-9a20-230e5125989f', '800a9804-c45e-40f3-8ea0-976a093077d1', '7bd84e63-857c-43fc-a123-4064fd7978ec'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:33 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858 Apr 08 15:49:33 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:33 devstack sudo[83858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:33 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:34 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.625s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:34 devstack sudo[83864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87 Apr 08 15:49:34 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:34 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3a0809e0-6b9e-43c6-a234-d53430e94858" returned: 0 in 0.572s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "cinder-quobyte-3a0809e0-6b9e-43c6-a234-d53430e94858" released by "delete_volume" :: held 1.588s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Created reservations ['bbaedc22-e90d-44f6-9e95-d6cdd6afa7c6', 'b9051a2d-c8f7-4075-9b6b-5422d66cdcc1', 'd081c4de-1be7-4871-b3d6-80db734d5728', 'b0e83ff4-ba77-4beb-8f91-01cd72b0b571'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:34 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:34 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "cinder-aae4028e-69b3-4601-a063-7516bbef3b60-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-aae4028e-69b3-4601-a063-7516bbef3b60-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "cinder-quobyte-aae4028e-69b3-4601-a063-7516bbef3b60" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-quobyte-aae4028e-69b3-4601-a063-7516bbef3b60" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:34 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.844s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Deleted volume successfully. Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40057497-fe07-4233-835d-437d3ea81ef8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-05bfa850-e48a-4d51-ad73-585a8be3eb7a tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-ad4512bf-902b-4f12-a8f3-2fa696c91cc0-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:34 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 Apr 08 15:49:34 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:34 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" returned: 0 in 0.710s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-a278ac99-c7fe-4a60-aebc-5212c3a9ff87" released by "delete_volume" :: held 1.366s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['f863e830-6401-45a0-948a-92de7855ba29'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:34 devstack cinder-volume[82216]: WARNING cinder.db.sqlalchemy.api [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1850633477'] Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['e9af568b-462e-4c04-beef-f22176f4e2c0', '05609b4a-ceb0-437b-9c34-bdd56935a9aa', 'f58e66f0-21b4-4480-bf31-000a386d0bad', '12438130-40e7-4dd7-a3a0-a67be8cff191'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:35 devstack sudo[83874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:35 devstack sudo[83874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:35 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.879s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Deleted volume successfully. Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3c2bb2e3-d499-4594-9bff-1b418c84ed90 tempest-DeleteServersTestJSON-445347885 None] Lock "cinder-3a0809e0-6b9e-43c6-a234-d53430e94858-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:35 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60" returned: 0 in 0.702s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:35 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60 Apr 08 15:49:35 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:35 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aae4028e-69b3-4601-a063-7516bbef3b60" returned: 0 in 0.489s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-quobyte-aae4028e-69b3-4601-a063-7516bbef3b60" released by "delete_volume" :: held 1.236s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:35 devstack sudo[83874]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.905s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Created reservations ['29a6b43f-2fbc-4304-925a-17cf97f7b917', '4af5cdab-7064-46c7-95fc-baba4d70a335', '171162d2-057d-4ee8-9ce9-1619717decd3', '0acbd02d-cb0d-49fb-9ba8-7189840a4430'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-10becaec-457a-420c-bda0-23dce5006b01 tempest-GroupSnapshotsTest-114372246 None] Delete group completed successfully. Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:35 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:35 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bf582b3c-8f62-4f58-a13b-888ce10d1a4c tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1711006262: creating Apr 08 15:49:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bf582b3c-8f62-4f58-a13b-888ce10d1a4c tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1711006262: created successfully Apr 08 15:49:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bf582b3c-8f62-4f58-a13b-888ce10d1a4c tempest-GroupSnapshotsTest-114372246 None] Create group completed successfully. Apr 08 15:49:36 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.539s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:36 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Deleted volume successfully. Apr 08 15:49:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-49a223c4-c0bc-4025-bacf-0e8fac835367 tempest-ServersNegativeTestJSON-59551921 None] Lock "cinder-aae4028e-69b3-4601-a063-7516bbef3b60-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (5fe376d3-7e5f-4646-bdc5-e6aa0b193184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fdbb9c-51b3-4f44-a649-9be4898ae08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fdbb9c-51b3-4f44-a649-9be4898ae08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137566738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b27eea9d-40ac-4219-b22d-440edd0191eb,host='devstack@QuobyteHD#QuobyteHD',id=83b47a77-13a7-41e6-a39b-519e0b67c891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:38Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686129c1-7c10-4c81-8b9a-0ce625745ec5),volume_type_id=686129c1-7c10-4c81-8b9a-0ce625745ec5)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c75c63-bb18-400b-a721-a2fa0e56fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c75c63-bb18-400b-a721-a2fa0e56fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dd83c6-cb20-491e-a09c-e77341c00f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dd83c6-cb20-491e-a09c-e77341c00f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b47a77-13a7-41e6-a39b-519e0b67c891', 'volume_name': 'volume-83b47a77-13a7-41e6-a39b-519e0b67c891', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca38277-c907-4547-848f-75fe6991fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca38277-c907-4547-848f-75fe6991fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cc7de0-c304-40c8-91e4-458286dff859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:37 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Volume 83b47a77-13a7-41e6-a39b-519e0b67c891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b47a77-13a7-41e6-a39b-519e0b67c891', 'volume_size': 1} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b27eea9d-40ac-4219-b22d-440edd0191eb,created_at=2026-04-08T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137566738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b27eea9d-40ac-4219-b22d-440edd0191eb,host='devstack@QuobyteHD#QuobyteHD',id=83b47a77-13a7-41e6-a39b-519e0b67c891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:38Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686129c1-7c10-4c81-8b9a-0ce625745ec5),volume_type_id=686129c1-7c10-4c81-8b9a-0ce625745ec5)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Creating volume 83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:37 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:37 devstack sudo[83889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 1073741824 Apr 08 15:49:37 devstack sudo[83889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:38 devstack sudo[83889]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 1073741824" returned: 0 in 0.689s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:38 devstack sudo[83956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 Apr 08 15:49:38 devstack sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:39 devstack sudo[83956]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891" returned: 0 in 0.594s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cc7de0-c304-40c8-91e4-458286dff859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b47a77-13a7-41e6-a39b-519e0b67c891', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe36705-edeb-4369-b9b9-639e00f23b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:39 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Volume volume-83b47a77-13a7-41e6-a39b-519e0b67c891 (83b47a77-13a7-41e6-a39b-519e0b67c891): created successfully Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe36705-edeb-4369-b9b9-639e00f23b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (5fe376d3-7e5f-4646-bdc5-e6aa0b193184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3e3092c4-57eb-453b-8403-5b9c09687fca tempest-GroupSnapshotsTest-114372246 None] Created volume successfully. Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (db09c7d3-618a-4e03-b3a0-88eedcd0723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb10603-d4c0-4e6f-b828-bab07c94f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb10603-d4c0-4e6f-b828-bab07c94f22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1506965951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b27eea9d-40ac-4219-b22d-440edd0191eb,host='devstack@QuobyteHD#QuobyteHD',id=fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:40Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686129c1-7c10-4c81-8b9a-0ce625745ec5),volume_type_id=686129c1-7c10-4c81-8b9a-0ce625745ec5)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1816d682-6d11-41d4-8471-4ea9321016aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1816d682-6d11-41d4-8471-4ea9321016aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec6ddb-742d-48ac-b80e-a8d672fc7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec6ddb-742d-48ac-b80e-a8d672fc7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f', 'volume_name': 'volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff8302-7069-41cb-9686-aeb6786ad520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff8302-7069-41cb-9686-aeb6786ad520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96605759-eda3-48bd-91b7-4cb3e84fa0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:40 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Volume fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f', 'volume_size': 1} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b27eea9d-40ac-4219-b22d-440edd0191eb,created_at=2026-04-08T13:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1506965951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b27eea9d-40ac-4219-b22d-440edd0191eb,host='devstack@QuobyteHD#QuobyteHD',id=fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:40Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686129c1-7c10-4c81-8b9a-0ce625745ec5),volume_type_id=686129c1-7c10-4c81-8b9a-0ce625745ec5)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Creating volume fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:40 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:40 devstack sudo[83963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f 1073741824 Apr 08 15:49:40 devstack sudo[83963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:40 devstack sudo[83963]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f 1073741824" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:40 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f Apr 08 15:49:40 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:41 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96605759-eda3-48bd-91b7-4cb3e84fa0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0695a1-d139-4927-853e-bfa920b9167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Volume volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f (fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f): created successfully Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0695a1-d139-4927-853e-bfa920b9167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (db09c7d3-618a-4e03-b3a0-88eedcd0723d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b221d97c-5574-4754-bc95-c2e8a73fab27 tempest-GroupSnapshotsTest-114372246 None] Created volume successfully. Apr 08 15:49:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5014d985-48ba-40d2-8f3d-2551fde5a84c tempest-GroupSnapshotsTest-114372246 None] Update group completed successfully. Apr 08 15:49:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-399a7e57-286e-407b-8749-39b21cf9a214 tempest-GroupSnapshotsTest-114372246 None] Update group completed successfully. Apr 08 15:49:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e48a0235-f2a7-401a-98a7-a4b8ad23e676 tempest-GroupSnapshotsTest-114372246 None] Update group completed successfully. Apr 08 15:49:45 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-699172a5-7540-4566-9621-8ec96caf33fa tempest-GroupSnapshotsTest-114372246 None] Update group completed successfully. Apr 08 15:49:47 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] GroupSnapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: creating. Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Group snapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: creating. {{(pid=82216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Creating offline snapshot 65257efb-a7d2-4f18-aaaf-863371c19d01 of volume fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064997c-4c85-4239-a69a-660c74a7d23f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:47 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f Apr 08 15:49:47 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:47 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" returned: 0 in 0.559s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:47 devstack sudo[83987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 1G Apr 08 15:49:47 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:48 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 1G" returned: 0 in 0.566s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:48 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 Apr 08 15:49:48 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:49:49 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Flow 'volume_create_manager' (5a1db271-b8da-47df-b00b-9f6ad70dae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60758fdf-4180-413b-a06a-07d208f38bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01" returned: 0 in 0.599s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:49 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60758fdf-4180-413b-a06a-07d208f38bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1570872697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57869bdf-4fa4-437e-b987-c832d1d4e03f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b98cccd5dc0347a5a417b35bb5aaaa15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:49Z,use_quota=True,user_id='fdca8b2072594bfb9abb59be6bbccca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006d9de-f036-4966-90d1-fe2f3473e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006d9de-f036-4966-90d1-fe2f3473e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a13d8fc-d071-4f3d-ba02-1f4cc3f7c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:49 devstack sudo[83998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 Apr 08 15:49:49 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a13d8fc-d071-4f3d-ba02-1f4cc3f7c693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57869bdf-4fa4-437e-b987-c832d1d4e03f', 'volume_name': 'volume-57869bdf-4fa4-437e-b987-c832d1d4e03f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc618e7-c80f-4f1c-8753-e711f0705011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc618e7-c80f-4f1c-8753-e711f0705011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831a104c-e50c-475f-875c-319e82b10593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Volume 57869bdf-4fa4-437e-b987-c832d1d4e03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57869bdf-4fa4-437e-b987-c832d1d4e03f', 'volume_size': 1} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:49 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01" returned: 0 in 0.474s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:49 devstack sudo[84001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info Apr 08 15:49:49 devstack sudo[84001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:50 devstack sudo[84001]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info" returned: 0 in 0.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:50 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:50 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info Apr 08 15:49:50 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:50 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.info" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.301s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Creating offline snapshot ceca9262-fbaf-42f9-82d5-567b3aaacd66 of volume 83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faec831-90fe-48ff-a761-796166b04c10]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:50 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 Apr 08 15:49:50 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:51 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891" returned: 0 in 0.540s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:51 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 1G Apr 08 15:49:51 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:51 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 1G" returned: 0 in 0.634s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b47a77-13a7-41e6-a39b-519e0b67c891 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:51 devstack sudo[84044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b47a77-13a7-41e6-a39b-519e0b67c891 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 Apr 08 15:49:51 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:52 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b47a77-13a7-41e6-a39b-519e0b67c891 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:52 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:52 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 Apr 08 15:49:52 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:52 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66" returned: 0 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:52 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info Apr 08 15:49:52 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:53 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info" returned: 0 in 0.411s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:53 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:53 devstack sudo[84058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info Apr 08 15:49:53 devstack sudo[84058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:53 devstack sudo[84058]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.info" returned: 0 in 0.427s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.574s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1570872697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57869bdf-4fa4-437e-b987-c832d1d4e03f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b98cccd5dc0347a5a417b35bb5aaaa15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:49:49Z,use_quota=True,user_id='fdca8b2072594bfb9abb59be6bbccca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Creating volume 57869bdf-4fa4-437e-b987-c832d1d4e03f {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:49:53 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:49:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:53 devstack sudo[84065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f 1073741824 Apr 08 15:49:53 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-882052c5-7946-4208-9a8a-ec4a77ff10f2 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: created successfully Apr 08 15:49:54 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f 1073741824" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:54 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f Apr 08 15:49:54 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:54 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f" returned: 0 in 0.437s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:54 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: deleting Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831a104c-e50c-475f-875c-319e82b10593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57869bdf-4fa4-437e-b987-c832d1d4e03f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca46e38b-1173-4acb-aa58-3471734e00c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: deleting {{(pid=82216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 15:49:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Volume volume-57869bdf-4fa4-437e-b987-c832d1d4e03f (57869bdf-4fa4-437e-b987-c832d1d4e03f): created successfully Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca46e38b-1173-4acb-aa58-3471734e00c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Flow 'volume_create_manager' (5a1db271-b8da-47df-b00b-9f6ad70dae3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:49:54 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-419fdd47-b9e6-4fc4-bd00-74598aeae1de req-69798100-6b1f-4f0a-8592-59f4e0ed54f5 tempest-VolumesGetTestJSON-2087642457 None] Created volume successfully. Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-65257efb-a7d2-4f18-aaaf-863371c19d01" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-65257efb-a7d2-4f18-aaaf-863371c19d01" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Deleting offline snapshot 65257efb-a7d2-4f18-aaaf-863371c19d01 of volume fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] snapshot_file for this snap is: volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bf453-6ca2-440d-8578-17677ae57a8a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:54 devstack sudo[84097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 Apr 08 15:49:54 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:55 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01" returned: 0 in 0.543s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[facc131d-c169-4474-9ff6-9c2d1053c0ef]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:55 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f Apr 08 15:49:55 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Acquiring lock "cinder-57869bdf-4fa4-437e-b987-c832d1d4e03f-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "cinder-57869bdf-4fa4-437e-b987-c832d1d4e03f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Acquiring lock "cinder-quobyte-57869bdf-4fa4-437e-b987-c832d1d4e03f" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "cinder-quobyte-57869bdf-4fa4-437e-b987-c832d1d4e03f" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae650ac-b069-4364-b787-ca28f19433aa]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:55 devstack sudo[84105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f Apr 08 15:49:55 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:56 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" returned: 0 in 0.742s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:56 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 Apr 08 15:49:56 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:56 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f" returned: 0 in 0.632s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:56 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f Apr 08 15:49:56 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:56 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01" returned: 0 in 0.534s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:56 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01 Apr 08 15:49:56 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:56 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57869bdf-4fa4-437e-b987-c832d1d4e03f" returned: 0 in 0.457s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "cinder-quobyte-57869bdf-4fa4-437e-b987-c832d1d4e03f" released by "delete_volume" :: held 1.154s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG cinder.quota [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Created reservations ['f9e100c7-7bae-4d6d-8621-900992be03a6', 'ff82a73c-fd83-4dc2-a7ce-8671d7da2c0e', 'c2a83c60-dd47-47ba-be9f-1c1ea103b505', '17dde386-b1b3-42e7-9e3d-f47d45bbb63c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:49:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:56 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:49:56 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:57 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f.65257efb-a7d2-4f18-aaaf-863371c19d01" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-65257efb-a7d2-4f18-aaaf-863371c19d01" released by "_delete_snapshot" :: held 2.361s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" released by "delete_snapshot" :: held 2.441s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-ceca9262-fbaf-42f9-82d5-567b3aaacd66" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-ceca9262-fbaf-42f9-82d5-567b3aaacd66" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Deleting offline snapshot ceca9262-fbaf-42f9-82d5-567b3aaacd66 of volume 83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] snapshot_file for this snap is: volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04f559-c389-4fc2-b716-090b046f2ab5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:57 devstack sudo[84129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 Apr 08 15:49:57 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:57 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.540s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.manager [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:49:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Deleted volume successfully. Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-3af7119c-d052-455d-a0f6-99ed3ea750e0 req-4c426d05-9084-4c36-9512-0dcb5d691196 tempest-VolumesGetTestJSON-2087642457 None] Lock "cinder-57869bdf-4fa4-437e-b987-c832d1d4e03f-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:57 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66" returned: 0 in 0.683s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b47a77-13a7-41e6-a39b-519e0b67c891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71f6a6-b260-4e05-b5fc-9b9dff27daa5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:49:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:58 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 Apr 08 15:49:58 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:58 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891" returned: 0 in 0.611s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:58 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 Apr 08 15:49:58 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:59 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66" returned: 0 in 0.577s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:49:59 devstack sudo[84160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66 Apr 08 15:49:59 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:49:59 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891.ceca9262-fbaf-42f9-82d5-567b3aaacd66" returned: 0 in 0.613s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-ceca9262-fbaf-42f9-82d5-567b3aaacd66" released by "_delete_snapshot" :: held 2.549s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" released by "delete_snapshot" :: held 2.565s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:49:59 devstack cinder-volume[82216]: WARNING cinder.quota [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-655734150 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-655734150, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:59 devstack cinder-volume[82216]: WARNING cinder.quota [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-655734150 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-655734150, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['ee84aef1-bd1f-4594-ab1c-9228a3c5ebd8', 'abb6b014-5a2e-47de-801b-a1f6c1d096aa', '22fe7857-f167-4be6-878f-b45eb78d62ed', 'a35dc177-2752-40bb-9718-08f8a797eab1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:49:59 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['60f0bb4f-3c14-4e0f-b463-fc6d286bdcd3', 'cf36f569-75b5-45ba-9e27-f967733c55b0', '10867daf-4381-4bf6-9f05-d78b9c0f088f', '203f947b-dd4e-4282-99ca-e421b16d805d'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bdbc9795-d9ed-41b8-b6ec-236d73818e36 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 8ad1ca8f-45f4-474a-8d75-eb4c48e130ac: deleted successfully Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:UPDATE=118,cinder:SELECT=124,cinder:DELETE=8,cinder:INSERT=26 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9565dbf1-d990-4f8d-8674-ed998f1a66b7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:01 devstack sudo[84183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 Apr 08 15:50:01 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=108,cinder:UPDATE=119,cinder:INSERT=27,cinder:DELETE=5 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:50:01 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891" returned: 0 in 0.575s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:01 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891 Apr 08 15:50:01 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:02 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-83b47a77-13a7-41e6-a39b-519e0b67c891" returned: 0 in 0.823s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-83b47a77-13a7-41e6-a39b-519e0b67c891" released by "delete_volume" :: held 1.456s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a0b7f-6941-4b7b-bbc8-f93166e29374]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:02 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f Apr 08 15:50:02 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:03 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" returned: 0 in 0.726s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:03 devstack sudo[84243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f Apr 08 15:50:03 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:04 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" returned: 0 in 0.983s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-fbdb7ae9-b9cd-4a64-bbc8-abb72e0d5f0f" released by "delete_volume" :: held 1.795s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Created reservations ['85995a64-c888-482e-b942-16effb32aafc'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:04 devstack cinder-volume[82216]: WARNING cinder.quota [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-655734150 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-655734150, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Created reservations ['1772f406-6e3e-455a-8356-56bf9c567b04', '1aa9eb88-e995-4979-b996-bd00c0535e04', '297087d2-e25e-4ad8-9fb0-12fd49766734', '0d88bbfc-d6f0-4631-9886-8c5d1a142f74'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Created reservations ['11c87a2e-9891-4a07-862f-9174b08a915f', '1418bfc4-eeda-45d3-950a-2d8715776f48', 'f93316da-ab9a-42d5-b5d1-8e7734a31161', '7793046d-6307-4d7c-8c63-b922eea5b762'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:05 devstack sudo[84274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:50:05 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Flow 'volume_create_manager' (a3cf5778-4a59-448d-bd21-4680fb2197d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ff7d53-4daa-4612-b41c-6b89e1abd159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ff7d53-4daa-4612-b41c-6b89e1abd159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-161574695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc8e4d1-935a-4baf-b5ae-60705e8294fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a18adfbc49484da38ea769f5563a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:05Z,use_quota=True,user_id='b30c74b7cdc344ad93fc544f57dae95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d372b-34f0-41d4-aec5-fbd7f90cdf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d372b-34f0-41d4-aec5-fbd7f90cdf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3550a564-8967-4b08-91bb-b5b339ec995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3550a564-8967-4b08-91bb-b5b339ec995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc8e4d1-935a-4baf-b5ae-60705e8294fd', 'volume_name': 'volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe90195e-d29a-4aca-8d02-7ce1d30f74bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe90195e-d29a-4aca-8d02-7ce1d30f74bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6d0885-4f38-4b31-b9c1-688df6dbaa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:05 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd', 'volume_size': 1} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-161574695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc8e4d1-935a-4baf-b5ae-60705e8294fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a18adfbc49484da38ea769f5563a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:05Z,use_quota=True,user_id='b30c74b7cdc344ad93fc544f57dae95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Creating volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:50:05 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:50:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:05 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd 1073741824 Apr 08 15:50:05 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:06 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.034s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:06 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:50:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-79bdb88d-797d-472d-9d20-e17fa4b0edcd tempest-GroupSnapshotsTest-114372246 None] Delete group completed successfully. Apr 08 15:50:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d0ef8f1-2cb3-4555-b353-71b554ad9b8a tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1832883436: creating Apr 08 15:50:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d0ef8f1-2cb3-4555-b353-71b554ad9b8a tempest-GroupSnapshotsTest-114372246 None] Group tempest-GroupSnapshotsTest-Group-1832883436: created successfully Apr 08 15:50:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d0ef8f1-2cb3-4555-b353-71b554ad9b8a tempest-GroupSnapshotsTest-114372246 None] Create group completed successfully. Apr 08 15:50:07 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd 1073741824" returned: 0 in 1.376s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:07 devstack sudo[84306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd Apr 08 15:50:07 devstack sudo[84306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:07 devstack sudo[84306]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6d0885-4f38-4b31-b9c1-688df6dbaa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23fbac3-b69a-4506-8fd1-388da297b4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Volume volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd (ccc8e4d1-935a-4baf-b5ae-60705e8294fd): created successfully Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23fbac3-b69a-4506-8fd1-388da297b4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Flow 'volume_create_manager' (a3cf5778-4a59-448d-bd21-4680fb2197d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d7fbd93-f367-467e-930d-8ce686abe0ce tempest-SnapshotsActionsTest-1701999038 None] Created volume successfully. Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (2f34b787-ee88-4949-9c8c-6600bff0e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c73ba7d-0064-4d1e-a3ed-084fc6c7c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c73ba7d-0064-4d1e-a3ed-084fc6c7c27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113890430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b9b74bf-9320-4049-ba13-8b9afa467029,host='devstack@QuobyteHD#QuobyteHD',id=48f6c4a5-dbdc-4b63-909e-8b8c62390060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:08Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0bea16b-92ba-4410-af22-c97828cb63c9),volume_type_id=c0bea16b-92ba-4410-af22-c97828cb63c9)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b2880-ba9a-4147-b26c-d69c0a78e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b2880-ba9a-4147-b26c-d69c0a78e14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce94e1e4-12a0-471a-b399-2ef75f40b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce94e1e4-12a0-471a-b399-2ef75f40b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f6c4a5-dbdc-4b63-909e-8b8c62390060', 'volume_name': 'volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e65f0b5-09ce-4fb8-88cf-93ba889c05a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e65f0b5-09ce-4fb8-88cf-93ba889c05a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f8bb8-b457-41d2-bf71-d84084fc3c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:08 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Volume 48f6c4a5-dbdc-4b63-909e-8b8c62390060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060', 'volume_size': 1} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b9b74bf-9320-4049-ba13-8b9afa467029,created_at=2026-04-08T13:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113890430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b9b74bf-9320-4049-ba13-8b9afa467029,host='devstack@QuobyteHD#QuobyteHD',id=48f6c4a5-dbdc-4b63-909e-8b8c62390060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00ea9412e747c08c71c495e1a2207e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:08Z,use_quota=True,user_id='ba120ba7077e47c8832ac3f9eb570526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0bea16b-92ba-4410-af22-c97828cb63c9),volume_type_id=c0bea16b-92ba-4410-af22-c97828cb63c9)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Creating volume 48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:50:08 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:50:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:08 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 1073741824 Apr 08 15:50:08 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:09 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 1073741824" returned: 0 in 1.200s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:10 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 Apr 08 15:50:10 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:10 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060" returned: 0 in 0.805s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.785s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Creating offline snapshot 02878a1c-8b04-46c2-a6da-23a8cdbd4b7c of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f8bb8-b457-41d2-bf71-d84084fc3c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e83b8c-e7ba-43b7-8f77-d22da36d3db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deebad6-0d87-4541-896f-ca3c9a9f6424]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:10 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Volume volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 (48f6c4a5-dbdc-4b63-909e-8b8c62390060): created successfully Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e83b8c-e7ba-43b7-8f77-d22da36d3db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Flow 'volume_create_manager' (2f34b787-ee88-4949-9c8c-6600bff0e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-80fc4964-8240-4bf4-b1f1-4767afd37900 tempest-GroupSnapshotsTest-114372246 None] Created volume successfully. Apr 08 15:50:10 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd Apr 08 15:50:10 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:11 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" returned: 0 in 0.546s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:11 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c 1G Apr 08 15:50:11 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] GroupSnapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: creating. Apr 08 15:50:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Group snapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: creating. {{(pid=82216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 15:50:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:12 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c 1G" returned: 0 in 0.744s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:12 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:12 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:12 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.715s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:12 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c is being set with open permissions: ugo+rw Apr 08 15:50:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:12 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:12 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:13 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:13 devstack sudo[84393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info Apr 08 15:50:13 devstack sudo[84393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:13 devstack sudo[84393]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info" returned: 0 in 0.447s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:13 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info is being set with open permissions: ugo+rw Apr 08 15:50:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:13 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info Apr 08 15:50:13 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:14 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.info" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.508s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.337s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Creating offline snapshot e336ecb3-cc76-4f90-af03-0f1074811b39 of volume 48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6f24137c-256e-4be7-b77d-7689fe2d0f56 tempest-SnapshotsActionsTest-1701999038 None] Create snapshot completed successfully Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ded6d97-1cc3-4901-a9c6-269fba7e4616]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:14 devstack sudo[84406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 Apr 08 15:50:14 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:14 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060" returned: 0 in 0.611s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:14 devstack sudo[84413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 1G Apr 08 15:50:14 devstack sudo[84413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:15 devstack sudo[84413]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 1G" returned: 0 in 0.899s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:15 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 Apr 08 15:50:15 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:16 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:16 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:50:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:16 devstack sudo[84424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 Apr 08 15:50:16 devstack sudo[84424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:16 devstack sudo[84424]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39" returned: 0 in 0.432s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:16 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info Apr 08 15:50:16 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:17 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info" returned: 0 in 0.621s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:17 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:50:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:17 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info Apr 08 15:50:17 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:17 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.info" returned: 0 in 0.516s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.688s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.237s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Creating offline snapshot b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d563a2-d08a-41db-9057-165309c2a302]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-aee29e86-1661-48e4-84f4-4f54a581c91b tempest-GroupSnapshotsTest-114372246 None] group_snapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: created successfully Apr 08 15:50:18 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:18 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: deleting Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: deleting {{(pid=82216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-e336ecb3-cc76-4f90-af03-0f1074811b39" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-e336ecb3-cc76-4f90-af03-0f1074811b39" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Deleting offline snapshot e336ecb3-cc76-4f90-af03-0f1074811b39 of volume 48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] snapshot_file for this snap is: volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6e96c-6ad6-407e-92a2-2b7cbfcb5a86]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:18 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 Apr 08 15:50:18 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:19 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 1.129s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:19 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 1G Apr 08 15:50:19 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:19 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39" returned: 0 in 0.882s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a7b50b-6a43-4e29-bf24-c99b3efd8841]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:20 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 Apr 08 15:50:20 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Flow 'volume_create_manager' (7b06ae20-6c55-47f1-bdde-f1d40b3f4601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308c3749-82c8-4af2-98fe-61042f4ffb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308c3749-82c8-4af2-98fe-61042f4ffb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-265863256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9193794f-b50c-4f48-952e-e6301c91b0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c3b41c714487c92adfad7d866b29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:21Z,use_quota=True,user_id='7d8debf247c84cccb4b3c616b0191261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec6c70d-ad62-4c7b-be80-d1196d9c10e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:20 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec6c70d-ad62-4c7b-be80-d1196d9c10e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71171b6c-e980-4fc4-9bb4-667ee8f0ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71171b6c-e980-4fc4-9bb4-667ee8f0ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9193794f-b50c-4f48-952e-e6301c91b0ec', 'volume_name': 'volume-9193794f-b50c-4f48-952e-e6301c91b0ec', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b258c36c-448b-4e51-a93f-d77b48a80b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b258c36c-448b-4e51-a93f-d77b48a80b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1394588c-0ee6-40a1-a58e-8e349e87d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Volume 9193794f-b50c-4f48-952e-e6301c91b0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9193794f-b50c-4f48-952e-e6301c91b0ec', 'volume_size': 1} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 1G" returned: 0 in 1.356s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:20 devstack sudo[84488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 Apr 08 15:50:20 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:20 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060" returned: 0 in 1.090s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:21 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 Apr 08 15:50:21 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:21 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" returned: 0 in 0.674s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:21 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 is being set with open permissions: ugo+rw Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:21 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 Apr 08 15:50:21 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:21 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:50:21 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:21 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39" returned: 0 in 0.785s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:21 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39 Apr 08 15:50:21 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:21 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.902s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-265863256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9193794f-b50c-4f48-952e-e6301c91b0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c3b41c714487c92adfad7d866b29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:21Z,use_quota=True,user_id='7d8debf247c84cccb4b3c616b0191261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Creating volume 9193794f-b50c-4f48-952e-e6301c91b0ec {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:50:21 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:50:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-57422a0e-33a6-46a8-81b1-c69e84468361 tempest-SnapshotsActionsTest-1701999038 None] Create snapshot completed successfully Apr 08 15:50:22 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec 1073741824 Apr 08 15:50:22 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:22 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.090s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Deleting offline snapshot b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] snapshot_file for this snap is: volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcff82-cada-4e9f-abbe-88727faaad1a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:22 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060.e336ecb3-cc76-4f90-af03-0f1074811b39" returned: 0 in 1.135s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:22 devstack sudo[84515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 Apr 08 15:50:22 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-e336ecb3-cc76-4f90-af03-0f1074811b39" released by "_delete_snapshot" :: held 4.111s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" released by "delete_snapshot" :: held 4.135s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:23 devstack cinder-volume[82216]: WARNING cinder.quota [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1075301767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1075301767, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:23 devstack cinder-volume[82216]: WARNING cinder.quota [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1075301767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1075301767, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['28da6eae-48d9-40c5-ade8-ea1fcbdf71bb', 'b89d4db2-7ef9-47b9-a5be-b883525d5ef4', 'f2637c33-abbf-463c-a385-a8f8df72eb1e', '551d731a-7635-473f-9caf-1347868a52fa'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f9eb0361-d832-4351-85f5-ba34e3814107 tempest-GroupSnapshotsTest-114372246 None] group_snapshot 9893e2d8-59e8-4c25-9624-3ab1901243d0: deleted successfully Apr 08 15:50:23 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec 1073741824" returned: 0 in 1.344s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:23 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec Apr 08 15:50:23 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" acquired by "delete_volume" :: waited 0.051s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aba8c9-a214-4830-9e1a-f24cc92e9c82]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:23 devstack sudo[84520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 Apr 08 15:50:23 devstack sudo[84520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:24 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" returned: 0 in 1.478s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f752e-2793-4971-8ec7-1dc08f6e2a70]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:24 devstack sudo[84525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:24 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:24 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec" returned: 0 in 1.623s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] <== create_volume: return (3014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.022s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1394588c-0ee6-40a1-a58e-8e349e87d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9193794f-b50c-4f48-952e-e6301c91b0ec', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559e6441-80b3-4db5-aeb1-2ea3464bafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Volume volume-9193794f-b50c-4f48-952e-e6301c91b0ec (9193794f-b50c-4f48-952e-e6301c91b0ec): created successfully Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559e6441-80b3-4db5-aeb1-2ea3464bafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Flow 'volume_create_manager' (7b06ae20-6c55-47f1-bdde-f1d40b3f4601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-27ec8cf4-2ed1-4ad7-9440-1fa04ae4fc07 tempest-ServerRescueNegativeTestJSON-123973433 None] Created volume successfully. Apr 08 15:50:25 devstack sudo[84520]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060" returned: 0 in 1.366s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:25 devstack sudo[84532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060 Apr 08 15:50:25 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Flow 'volume_create_manager' (a2135ba1-3993-4533-bdcf-54afd4dfe9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dba96fa-a381-4835-8f6f-cebff595ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dba96fa-a381-4835-8f6f-cebff595ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:25Z,deleted=False,deleted_at=None,display_description='',display_name='4d8ace8e-ea10-48c2-8870-dda916282bb8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2a0cfa-6834-4215-aeea-c0f22784807f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a881f3a86471d8e8a42b7be582079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:26Z,use_quota=True,user_id='7056d1dc8e06478f83455a6160310c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395cfb-0933-4c90-9a3c-dc448e1a20ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395cfb-0933-4c90-9a3c-dc448e1a20ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec14eb8a-01e5-4c65-a250-3f97dfdbe8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec14eb8a-01e5-4c65-a250-3f97dfdbe8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2a0cfa-6834-4215-aeea-c0f22784807f', 'volume_name': 'volume-4c2a0cfa-6834-4215-aeea-c0f22784807f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6286a388-49d8-486a-a9e7-d0b7b48194be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6286a388-49d8-486a-a9e7-d0b7b48194be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d78f5-ad0e-4445-a4eb-1470aa0afeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume 4c2a0cfa-6834-4215-aeea-c0f22784807f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2a0cfa-6834-4215-aeea-c0f22784807f', 'volume_size': 1} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:25Z,deleted=False,deleted_at=None,display_description='',display_name='4d8ace8e-ea10-48c2-8870-dda916282bb8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2a0cfa-6834-4215-aeea-c0f22784807f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a881f3a86471d8e8a42b7be582079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:26Z,use_quota=True,user_id='7056d1dc8e06478f83455a6160310c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Creating volume 4c2a0cfa-6834-4215-aeea-c0f22784807f {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:50:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:26 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-48f6c4a5-dbdc-4b63-909e-8b8c62390060" returned: 0 in 0.850s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:26 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:26 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f 1073741824 Apr 08 15:50:26 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 1.756s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Lock "cinder-quobyte-48f6c4a5-dbdc-4b63-909e-8b8c62390060" released by "delete_volume" :: held 2.410s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:26 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 Apr 08 15:50:26 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['40e66e40-99ab-48ee-b8f7-612c4057dd4a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:26 devstack cinder-volume[82216]: WARNING cinder.quota [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1075301767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1075301767, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Created reservations ['bd503816-0a92-4ffd-b2f6-8b150c38ff6d', 'b752ec54-a25d-4c1e-992d-f2119f06e9e0', '0aac0673-13a4-41d3-9a98-7762ec352836', '70fe09fa-f213-4944-b836-6e834f1994ee'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:26 devstack sudo[84544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:50:26 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:28 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f 1073741824" returned: 0 in 2.035s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:28 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f Apr 08 15:50:28 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:28 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" returned: 0 in 2.434s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:28 devstack sudo[84558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96 Apr 08 15:50:28 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:28 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 2.012s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:28 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:50:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-682cc884-3067-41fb-be32-1177db19d2a2 tempest-GroupSnapshotsTest-114372246 None] Delete group completed successfully. Apr 08 15:50:29 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" returned: 0 in 1.144s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96" released by "_delete_snapshot" :: held 7.032s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_snapshot" :: held 7.071s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:29 devstack cinder-volume[82216]: WARNING cinder.quota [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:29 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f" returned: 0 in 1.701s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] <== create_volume: return (3791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.800s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d78f5-ad0e-4445-a4eb-1470aa0afeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2a0cfa-6834-4215-aeea-c0f22784807f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516a125b-c82d-4059-abb3-c32426693dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Created reservations ['ea526387-891a-4330-8ad2-5a3479fb94bd', 'da865c60-7928-4e0c-8866-261afa17fa3f', '95f8afac-9336-469a-b417-757b0ffb1a97', '48ee2606-026f-45a6-8fd4-4ec3dee18a6e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:29 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume volume-4c2a0cfa-6834-4215-aeea-c0f22784807f (4c2a0cfa-6834-4215-aeea-c0f22784807f): created successfully Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516a125b-c82d-4059-abb3-c32426693dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Flow 'volume_create_manager' (a2135ba1-3993-4533-bdcf-54afd4dfe9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-a9505be7-5248-4640-9dc8-303a049e146e tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Created volume successfully. Apr 08 15:50:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Delete snapshot completed successfully. Apr 08 15:50:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c97eeaf5-afec-4c5d-8059-b00310468c47 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-b0dc191c-e6ba-4a47-84de-2e7e9f90fc96-delete_snapshot" released by "delete_snapshot" :: held 7.278s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Creating offline snapshot a62fbbe4-fe00-405b-82ec-c6f02df0210d of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6fa1ca-b315-437d-bc03-5ff3d61a9e9e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:31 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:31 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:31 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 1.052s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:32 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d 1G Apr 08 15:50:32 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:33 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d 1G" returned: 0 in 1.041s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:33 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d Apr 08 15:50:33 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:33 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d" returned: 0 in 0.602s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:33 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d is being set with open permissions: ugo+rw Apr 08 15:50:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:33 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d Apr 08 15:50:33 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-dc4c3a03-e3cf-4cc2-8dfd-546b89a26119 tempest-GroupSnapshotsV319Test-178892276 None] Group tempest-GroupSnapshotsV319Test-Group-420872063: creating Apr 08 15:50:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-dc4c3a03-e3cf-4cc2-8dfd-546b89a26119 tempest-GroupSnapshotsV319Test-178892276 None] Group tempest-GroupSnapshotsV319Test-Group-420872063: created successfully Apr 08 15:50:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-dc4c3a03-e3cf-4cc2-8dfd-546b89a26119 tempest-GroupSnapshotsV319Test-178892276 None] Create group completed successfully. Apr 08 15:50:34 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d" returned: 0 in 0.580s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.424s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.507s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa7192f-a9cf-4b8c-a178-52d5aef131ad]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fde75b50-86b5-4cb3-8bfb-f99195cb604a tempest-SnapshotsActionsTest-1701999038 None] Create snapshot completed successfully Apr 08 15:50:34 devstack sudo[84641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f Apr 08 15:50:34 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:34 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f" returned: 0 in 0.475s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.486s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8', 'name': 'volume-4c2a0cfa-6834-4215-aeea-c0f22784807f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be6c239d-01a7-417a-baf6-5334329b1267', 'enforce_multipath': True} {{(pid=82216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 15:50:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-ed9f9b33-d814-444a-9f11-bcfcf6748374 req-d00e390d-09b6-4bd2-80f3-c9bdee4967ee tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] attachment_update completed successfully. Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Flow 'volume_create_manager' (fd8d686f-b9b9-46bb-a4bb-6233d2ecc579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e42a942-de08-4229-b3a3-11d7f6528508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-a62fbbe4-fe00-405b-82ec-c6f02df0210d-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e42a942-de08-4229-b3a3-11d7f6528508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995507107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d5ecfe-7e16-4c67-9139-11a199aeb7e3,host='devstack@QuobyteHD#QuobyteHD',id=d712f522-1f18-4438-a24c-c196545f73e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca7bbe7d401e474fabaec5d974745556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:35Z,use_quota=True,user_id='ee6272301fed4679bb534dbe48c1f69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e682285-514f-457f-a8d0-a1f83c8a9b60),volume_type_id=6e682285-514f-457f-a8d0-a1f83c8a9b60)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ba90ab-3d67-4563-9a5f-173a86cf3902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ba90ab-3d67-4563-9a5f-173a86cf3902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8884c469-bcd3-4a27-9d8f-ea7452e453cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8884c469-bcd3-4a27-9d8f-ea7452e453cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd712f522-1f18-4438-a24c-c196545f73e9', 'volume_name': 'volume-d712f522-1f18-4438-a24c-c196545f73e9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a8348d-b452-424f-bb9d-4a6aaaef9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a8348d-b452-424f-bb9d-4a6aaaef9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf2c004-d0c1-4e66-b043-fd527074d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:35 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Volume d712f522-1f18-4438-a24c-c196545f73e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d712f522-1f18-4438-a24c-c196545f73e9', 'volume_size': 1} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25d5ecfe-7e16-4c67-9139-11a199aeb7e3,created_at=2026-04-08T13:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995507107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25d5ecfe-7e16-4c67-9139-11a199aeb7e3,host='devstack@QuobyteHD#QuobyteHD',id=d712f522-1f18-4438-a24c-c196545f73e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca7bbe7d401e474fabaec5d974745556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:50:35Z,use_quota=True,user_id='ee6272301fed4679bb534dbe48c1f69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e682285-514f-457f-a8d0-a1f83c8a9b60),volume_type_id=6e682285-514f-457f-a8d0-a1f83c8a9b60)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Creating volume d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:50:35 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-a62fbbe4-fe00-405b-82ec-c6f02df0210d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-a62fbbe4-fe00-405b-82ec-c6f02df0210d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-a62fbbe4-fe00-405b-82ec-c6f02df0210d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:35 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 1073741824 Apr 08 15:50:35 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Deleting offline snapshot a62fbbe4-fe00-405b-82ec-c6f02df0210d of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] snapshot_file for this snap is: volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dde5c7-3b74-4417-9c69-ef53455f968c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:35 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d Apr 08 15:50:35 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:36 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 1073741824" returned: 0 in 0.587s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:36 devstack sudo[84661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 Apr 08 15:50:36 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:36 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d" returned: 0 in 0.621s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb7b34-3838-4654-9e24-6427205bc279]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:36 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:36 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:37 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9" returned: 0 in 0.961s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf2c004-d0c1-4e66-b043-fd527074d61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d712f522-1f18-4438-a24c-c196545f73e9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e358c54d-ad07-473e-9f69-1421e8d6af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:50:37 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Volume volume-d712f522-1f18-4438-a24c-c196545f73e9 (d712f522-1f18-4438-a24c-c196545f73e9): created successfully Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e358c54d-ad07-473e-9f69-1421e8d6af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Flow 'volume_create_manager' (fd8d686f-b9b9-46bb-a4bb-6233d2ecc579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:50:37 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d470c02-781c-41d4-896f-fa6aefcc6af1 tempest-GroupSnapshotsV319Test-178892276 None] Created volume successfully. Apr 08 15:50:37 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 1.203s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:37 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d Apr 08 15:50:37 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:37 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] GroupSnapshot d0aaff22-62c1-458d-9470-2a91a65b011b: creating. Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Group snapshot d0aaff22-62c1-458d-9470-2a91a65b011b: creating. {{(pid=82216) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Creating offline snapshot cd39d790-6f87-4871-9cb4-c2450e71dd35 of volume d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa46ba9-e4b4-47cf-8deb-6bdbcf427373]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:38 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 Apr 08 15:50:38 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:38 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d" returned: 0 in 0.983s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:38 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d Apr 08 15:50:38 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:39 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9" returned: 0 in 0.981s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:39 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 1G Apr 08 15:50:39 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:39 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.a62fbbe4-fe00-405b-82ec-c6f02df0210d" returned: 0 in 1.214s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-a62fbbe4-fe00-405b-82ec-c6f02df0210d" released by "_delete_snapshot" :: held 4.121s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_snapshot" :: held 4.150s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Created reservations ['7cdeee99-f8aa-4d40-a555-29a8eadff016', '18d53bd0-0773-480c-849d-9c365d9f3219', 'a972ee75-83d5-4212-9129-b78cb355f1b3', '9e184893-dc54-4477-af0d-b4ba5349822a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Delete snapshot completed successfully. Apr 08 15:50:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-781c7da7-2bdb-4aa9-9caa-19d2da130ca6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-a62fbbe4-fe00-405b-82ec-c6f02df0210d-delete_snapshot" released by "delete_snapshot" :: held 4.304s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:40 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 1G" returned: 0 in 1.047s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d712f522-1f18-4438-a24c-c196545f73e9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:40 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d712f522-1f18-4438-a24c-c196545f73e9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 Apr 08 15:50:40 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:41 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d712f522-1f18-4438-a24c-c196545f73e9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35" returned: 0 in 1.400s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:41 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:50:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:41 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 Apr 08 15:50:41 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:42 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35" returned: 0 in 0.660s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:42 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info Apr 08 15:50:42 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:42 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info" returned: 0 in 0.602s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:42 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:50:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:42 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info Apr 08 15:50:42 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:43 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.info" returned: 0 in 0.597s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.396s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.795s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Creating offline snapshot 6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81e199-8895-437b-a6aa-cbe0ddba867b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-03152283-4dca-437f-9852-43d1eefadd2c tempest-GroupSnapshotsV319Test-178892276 None] group_snapshot d0aaff22-62c1-458d-9470-2a91a65b011b: created successfully Apr 08 15:50:43 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:43 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:44 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 1.112s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:44 devstack sudo[85233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db 1G Apr 08 15:50:44 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:45 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] group_snapshot d0aaff22-62c1-458d-9470-2a91a65b011b: deleting Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] group_snapshot d0aaff22-62c1-458d-9470-2a91a65b011b: deleting {{(pid=82216) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "cinder-quobyte-cd39d790-6f87-4871-9cb4-c2450e71dd35" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-cd39d790-6f87-4871-9cb4-c2450e71dd35" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Deleting offline snapshot cd39d790-6f87-4871-9cb4-c2450e71dd35 of volume d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] snapshot_file for this snap is: volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a0d18-a033-4fdc-b209-4e7d4fcecf6c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:45 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 Apr 08 15:50:45 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Acquiring lock "cinder-9193794f-b50c-4f48-952e-e6301c91b0ec-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "cinder-9193794f-b50c-4f48-952e-e6301c91b0ec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Acquiring lock "cinder-quobyte-9193794f-b50c-4f48-952e-e6301c91b0ec" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:46 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "cinder-quobyte-9193794f-b50c-4f48-952e-e6301c91b0ec" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db 1G" returned: 0 in 1.638s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a572f-06c2-45a2-b87f-246cdca921da]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:46 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db Apr 08 15:50:46 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:46 devstack sudo[85246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec Apr 08 15:50:46 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:46 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35" returned: 0 in 1.430s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d712f522-1f18-4438-a24c-c196545f73e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[317f9f9a-de8e-4231-b39d-39612cd26f7b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:46 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" returned: 0 in 0.731s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:47 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db is being set with open permissions: ugo+rw Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:47 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db Apr 08 15:50:47 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:47 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 Apr 08 15:50:47 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:47 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec" returned: 0 in 1.007s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:47 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec Apr 08 15:50:47 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:47 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9" returned: 0 in 0.739s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:47 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 Apr 08 15:50:47 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:48 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" returned: 0 in 1.081s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:48 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1b1054e4-a362-4566-9e53-5a34110f4a82 tempest-SnapshotsActionsTest-1701999038 None] Create snapshot completed successfully Apr 08 15:50:48 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9193794f-b50c-4f48-952e-e6301c91b0ec" returned: 0 in 0.956s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "cinder-quobyte-9193794f-b50c-4f48-952e-e6301c91b0ec" released by "delete_volume" :: held 2.029s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Created reservations ['e802091b-249f-4f9a-af69-f78cbb259df1', '1d00ae2c-aab1-4df2-b7b8-0646a05a3669', '489bf79d-7f3c-436b-99de-fc0e4fd42ad3', '720cc111-c280-4c0a-a795-bc310b3c8552'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:48 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:50:48 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:48 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35" returned: 0 in 0.771s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:48 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35 Apr 08 15:50:48 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:48 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.626s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:48 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:50:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Deleted volume successfully. Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f9363132-1d52-4e2e-a201-e5be996498d4 tempest-ServerRescueNegativeTestJSON-123973433 None] Lock "cinder-9193794f-b50c-4f48-952e-e6301c91b0ec-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Deleting offline snapshot 6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] snapshot_file for this snap is: volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf3d44-5cd6-47d7-9832-da23b5c4d411]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:49 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db Apr 08 15:50:49 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:49 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9.cd39d790-6f87-4871-9cb4-c2450e71dd35" returned: 0 in 0.864s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-cd39d790-6f87-4871-9cb4-c2450e71dd35" released by "_delete_snapshot" :: held 3.990s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" released by "delete_snapshot" :: held 4.015s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:49 devstack cinder-volume[82216]: WARNING cinder.quota [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1739073347 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1739073347, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:49 devstack cinder-volume[82216]: WARNING cinder.quota [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1739073347 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1739073347, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:49 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] Created reservations ['e910b9ed-22db-4eea-ab45-fc7d531d404d', '88b92c74-06f7-4849-914d-a3ee9da131f2', '99e24d67-ee4c-4d3f-b69f-8cf777c319fa', '7cd7ecc6-7c15-48af-a668-2e8a3e7a5236'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-909773b9-7370-4fbb-9f03-0c269b2c3298 tempest-GroupSnapshotsV319Test-178892276 None] group_snapshot d0aaff22-62c1-458d-9470-2a91a65b011b: deleted successfully Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:50 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" returned: 0 in 0.858s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2bf9f2-6027-4984-adb9-27080d2aa9ca]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[087689cb-91ab-4cf4-8496-abf8e0c1844d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:50 devstack sudo[85347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 Apr 08 15:50:50 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:50 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:50 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:50 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.754s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:50 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9" returned: 0 in 0.778s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:50 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db Apr 08 15:50:50 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:50 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9 Apr 08 15:50:50 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:51 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d712f522-1f18-4438-a24c-c196545f73e9" returned: 0 in 0.586s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Lock "cinder-quobyte-d712f522-1f18-4438-a24c-c196545f73e9" released by "delete_volume" :: held 1.439s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Created reservations ['5a984c4d-099d-4f9e-8f59-4469ae310e34'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:51 devstack cinder-volume[82216]: WARNING cinder.quota [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1739073347 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1739073347, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Created reservations ['a36bae71-b389-4171-bbb3-db6bf232207e', '10837dc3-b239-4acc-bea4-a02a35db9694', 'cc46d2ba-c1a0-4676-94d7-7213a999d98c', 'c046f06f-4428-4f9e-8c1e-10e31de85041'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:51 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:50:51 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:51 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" returned: 0 in 0.955s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:51 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db Apr 08 15:50:51 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:52 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.457s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:50:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b8a331e7-e080-4036-8f21-31f349fc8974 tempest-GroupSnapshotsV319Test-178892276 None] Delete group completed successfully. Apr 08 15:50:52 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db" released by "_delete_snapshot" :: held 3.121s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_snapshot" :: held 3.160s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Created reservations ['50332993-8b99-4197-a41b-07bf3ca3049e', '8aa7f9a0-e5c0-4d3a-9198-bb034bf8b66b', 'f3165bad-863c-48b8-9012-7989fa2a9aa2', '1ec26609-6ab4-4a63-8bbf-cfdc553825bd'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:50:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Delete snapshot completed successfully. Apr 08 15:50:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a395f291-36a7-40b0-bb1c-18627d2e28e6 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-6a2e9bd4-7c4b-4e22-abe7-c22293b8e9db-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:50:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:50:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:50:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Creating offline snapshot 01044d0d-2399-4bcd-8a04-24b502eae3ff of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:50:53 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc8433-d273-4ce4-982c-f29624489992]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:53 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:53 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:54 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.630s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:54 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff 1G Apr 08 15:50:54 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:55 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff 1G" returned: 0 in 0.923s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:55 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff Apr 08 15:50:55 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:55 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff" returned: 0 in 0.624s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:55 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff is being set with open permissions: ugo+rw Apr 08 15:50:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:55 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff Apr 08 15:50:55 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:56 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff" returned: 0 in 0.748s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:50:56 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d2d4dda1-5717-432e-8754-96d6cf423409 tempest-SnapshotsActionsTest-1701999038 None] Create snapshot completed successfully Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-01044d0d-2399-4bcd-8a04-24b502eae3ff-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-01044d0d-2399-4bcd-8a04-24b502eae3ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Acquiring lock "cinder-quobyte-01044d0d-2399-4bcd-8a04-24b502eae3ff" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-01044d0d-2399-4bcd-8a04-24b502eae3ff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Deleting offline snapshot 01044d0d-2399-4bcd-8a04-24b502eae3ff of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] snapshot_file for this snap is: volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ed8ad-cedd-4b26-8c66-aca6d3094b26]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:58 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff Apr 08 15:50:58 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:58 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff" returned: 0 in 0.716s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df30bd2c-d5a5-4ef3-b182-cd86bd445d4c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:50:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:58 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:50:59 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:50:59 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 08 15:50:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.581s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:50:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:50:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:50:59 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff Apr 08 15:50:59 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:00 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff" returned: 0 in 0.727s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:00 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff Apr 08 15:51:00 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:00 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.01044d0d-2399-4bcd-8a04-24b502eae3ff" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-01044d0d-2399-4bcd-8a04-24b502eae3ff" released by "_delete_snapshot" :: held 2.586s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_snapshot" :: held 2.619s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Created reservations ['43e621bc-cfdd-40d9-9c06-ff745d259ef8', '04e2b286-e0f3-494e-8542-238afae37969', '0ab86a13-48b5-495f-aef3-a061fe9f13f6', 'ae15c18c-c39b-46da-95ed-b1887adcd325'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Delete snapshot completed successfully. Apr 08 15:51:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3d94aaf-e4d8-4233-949b-9ff82588fb35 tempest-SnapshotsActionsTest-201814870 None] Lock "cinder-01044d0d-2399-4bcd-8a04-24b502eae3ff-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "cinder-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "cinder-quobyte-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Deleting offline snapshot 02878a1c-8b04-46c2-a6da-23a8cdbd4b7c of volume ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] snapshot_file for this snap is: volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8660a86a-f4fc-4d72-adec-78941b641190]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:01 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:51:01 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=110,cinder:UPDATE=122,cinder:INSERT=24,cinder:DELETE=5 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=115,cinder:UPDATE=100,cinder:INSERT=31,cinder:DELETE=6 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:51:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Flow 'volume_create_manager' (78384c2b-2b5c-4a16-b36f-b220f5125e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a67fa5-b909-4961-adf9-eebddc26daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a67fa5-b909-4961-adf9-eebddc26daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1363758694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f84434-a688-426e-b5d4-57210b57e2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736ace7d8500493b9bbad0094de1f63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:02Z,use_quota=True,user_id='fdba13216040456bb1ef41e3ffdd7570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ab12f-ddc4-40a2-a3bd-3b585a56f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ab12f-ddc4-40a2-a3bd-3b585a56f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159ac71c-3a04-4f17-8baa-3c865d1e33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159ac71c-3a04-4f17-8baa-3c865d1e33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f84434-a688-426e-b5d4-57210b57e2f3', 'volume_name': 'volume-09f84434-a688-426e-b5d4-57210b57e2f3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eab4554-0a47-47bc-b3f0-3c0fdb47c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eab4554-0a47-47bc-b3f0-3c0fdb47c70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777866a5-3326-4b86-9f0f-9237037cc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume 09f84434-a688-426e-b5d4-57210b57e2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f84434-a688-426e-b5d4-57210b57e2f3', 'volume_size': 1} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1363758694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f84434-a688-426e-b5d4-57210b57e2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736ace7d8500493b9bbad0094de1f63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:02Z,use_quota=True,user_id='fdba13216040456bb1ef41e3ffdd7570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Creating volume 09f84434-a688-426e-b5d4-57210b57e2f3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:02 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:02 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 1073741824 Apr 08 15:51:02 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:02 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.826s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196a5f9-1204-4b82-9f44-fca122a2f3cf]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:02 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd Apr 08 15:51:02 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:03 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 1073741824" returned: 0 in 0.863s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:03 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 Apr 08 15:51:03 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:03 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" returned: 0 in 0.679s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:03 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:51:03 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:03 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3" returned: 0 in 0.499s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777866a5-3326-4b86-9f0f-9237037cc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f84434-a688-426e-b5d4-57210b57e2f3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc70a59-ef95-4ca4-98b7-1a52b4892203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume volume-09f84434-a688-426e-b5d4-57210b57e2f3 (09f84434-a688-426e-b5d4-57210b57e2f3): created successfully Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc70a59-ef95-4ca4-98b7-1a52b4892203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Flow 'volume_create_manager' (78384c2b-2b5c-4a16-b36f-b220f5125e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:03 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b2a56c86-48ef-47f7-bbeb-1e2218ba2138 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Created volume successfully. Apr 08 15:51:03 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:03 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c Apr 08 15:51:03 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "cinder-09f84434-a688-426e-b5d4-57210b57e2f3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "cinder-09f84434-a688-426e-b5d4-57210b57e2f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "cinder-quobyte-09f84434-a688-426e-b5d4-57210b57e2f3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "cinder-quobyte-09f84434-a688-426e-b5d4-57210b57e2f3" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[646c897d-7a23-4ac5-a98b-3e0aba2af520]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:04 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 Apr 08 15:51:04 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:04 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd.02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" returned: 0 in 0.608s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c" released by "_delete_snapshot" :: held 2.818s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_snapshot" :: held 2.834s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Created reservations ['4d45be9a-bd7b-4226-beb6-1227369e900f', '12c1818c-816a-4663-940a-a22bc35515a4', '7903bd3d-8c77-47c2-a6e6-c184e0b1d7ae', 'e8afb60c-91bb-4c25-a484-0bdf7e6cd8b3'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Delete snapshot completed successfully. Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4bc195a7-9401-4206-8d1b-00a6c5995ca7 tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-02878a1c-8b04-46c2-a6da-23a8cdbd4b7c-delete_snapshot" released by "delete_snapshot" :: held 2.946s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "cinder-ccc8e4d1-935a-4baf-b5ae-60705e8294fd-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-ccc8e4d1-935a-4baf-b5ae-60705e8294fd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849e2f4-c08b-4e08-83d4-9674cfad940a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:05 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3" returned: 0 in 0.818s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:05 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3 Apr 08 15:51:05 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:05 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd Apr 08 15:51:05 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:05 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-09f84434-a688-426e-b5d4-57210b57e2f3" returned: 0 in 0.540s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "cinder-quobyte-09f84434-a688-426e-b5d4-57210b57e2f3" released by "delete_volume" :: held 1.415s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Created reservations ['c1f28912-f03d-4fa9-bdf0-c11fa9e8f59e', 'c8b6dc87-737c-4988-b907-c0e44e1e2b2c', '7163afd5-4fd8-48a4-aa7f-1bdf8ea400c7', '5c08af71-c6e2-4b53-8afa-40da93d8aa17'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:05 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" returned: 0 in 0.677s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:05 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd Apr 08 15:51:05 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:05 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:05 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:06 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-quobyte-ccc8e4d1-935a-4baf-b5ae-60705e8294fd" released by "delete_volume" :: held 1.247s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Created reservations ['a0650e42-1c9d-437a-87f8-6bb08cc0b230', '9e7b0f8e-b2b9-46bd-8b6a-7fd1dba3b2be', '33158cbe-4903-4ee1-952c-0e162f0b9b34', '67cd30f4-5c42-4b9a-8d4f-1902e0dadab1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:06 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.524s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Deleted volume successfully. Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3354d7cd-eeeb-42c2-b68a-90be7c8c0aaa tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "cinder-09f84434-a688-426e-b5d4-57210b57e2f3-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:06 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:06 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Flow 'volume_create_manager' (4470c68e-8a92-4c64-8572-411e53616c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a631566-8ce4-4b01-bdf1-dabaec1c091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a631566-8ce4-4b01-bdf1-dabaec1c091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-737592163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736ace7d8500493b9bbad0094de1f63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:07Z,use_quota=True,user_id='fdba13216040456bb1ef41e3ffdd7570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deea6f2e-94a2-4089-99f0-c51682a21d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deea6f2e-94a2-4089-99f0-c51682a21d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a5d9a-9136-4aa4-8d71-dfd428ab1023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a5d9a-9136-4aa4-8d71-dfd428ab1023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247', 'volume_name': 'volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f3db73-a5e2-44e5-b7e9-f23f723effcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f3db73-a5e2-44e5-b7e9-f23f723effcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af783b91-1aab-47d9-892c-8e3d90fa67a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:06 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume 1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247', 'volume_size': 1} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-737592163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736ace7d8500493b9bbad0094de1f63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:07Z,use_quota=True,user_id='fdba13216040456bb1ef41e3ffdd7570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Creating volume 1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:06 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:06 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 1073741824 Apr 08 15:51:06 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:06 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.531s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Deleted volume successfully. Apr 08 15:51:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94a01e0d-a26c-4d5e-9ab3-01349cb1b64e tempest-SnapshotsActionsTest-1701999038 None] Lock "cinder-ccc8e4d1-935a-4baf-b5ae-60705e8294fd-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:07 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 1073741824" returned: 0 in 0.607s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:07 devstack sudo[85643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 Apr 08 15:51:07 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Flow 'volume_create_manager' (5d44cf02-7633-44e5-b7f7-ba32bd010dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be453792-b332-411b-b9a5-34cb61c59a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be453792-b332-411b-b9a5-34cb61c59a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-614823804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692455a-4600-4a25-b618-9b6eae06e10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48143265ee3e4919b5c8e873396136bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:08Z,use_quota=True,user_id='2937c657b3964cc1a1b88c878670878e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d3715c-6a66-40e6-9a19-2bb6683406c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d3715c-6a66-40e6-9a19-2bb6683406c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49853261-16c3-43cd-9509-5c55a49e6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49853261-16c3-43cd-9509-5c55a49e6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6692455a-4600-4a25-b618-9b6eae06e10b', 'volume_name': 'volume-6692455a-4600-4a25-b618-9b6eae06e10b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1a7770-fc0f-4a2e-9fe6-53111959eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1a7770-fc0f-4a2e-9fe6-53111959eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8a1c5a-4706-4ca3-9a70-4af6b857c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Volume 6692455a-4600-4a25-b618-9b6eae06e10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6692455a-4600-4a25-b618-9b6eae06e10b', 'volume_size': 1} Apr 08 15:51:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:08 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-614823804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6692455a-4600-4a25-b618-9b6eae06e10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48143265ee3e4919b5c8e873396136bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:08Z,use_quota=True,user_id='2937c657b3964cc1a1b88c878670878e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Creating volume 6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:08 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:08 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b 1073741824 Apr 08 15:51:08 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af783b91-1aab-47d9-892c-8e3d90fa67a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b71c858-718b-43e7-86a1-45a5ba58d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:08 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Volume volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 (1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247): created successfully Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b71c858-718b-43e7-86a1-45a5ba58d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Flow 'volume_create_manager' (4470c68e-8a92-4c64-8572-411e53616c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f0e9176c-f761-49d0-b588-b2b6b39f8f14 tempest-VolumeQuotasAdminTestJSON-1110649014 None] Created volume successfully. Apr 08 15:51:08 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b 1073741824" returned: 0 in 0.608s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:08 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b Apr 08 15:51:08 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:09 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b" returned: 0 in 0.607s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8a1c5a-4706-4ca3-9a70-4af6b857c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6692455a-4600-4a25-b618-9b6eae06e10b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a3a1b-06fb-4c77-93b3-97bdc96b1e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:09 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Volume volume-6692455a-4600-4a25-b618-9b6eae06e10b (6692455a-4600-4a25-b618-9b6eae06e10b): created successfully Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a3a1b-06fb-4c77-93b3-97bdc96b1e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Flow 'volume_create_manager' (5d44cf02-7633-44e5-b7f7-ba32bd010dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-9fdca058-e873-4561-aa12-b1294b055c00 req-51d17fed-9c2a-41d6-9cd8-eaf848337357 tempest-VolumesSnapshotsTestJSON-2118744014 None] Created volume successfully. Apr 08 15:51:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5ba7df60-0243-42fe-bf0a-7a06d0cdeaf7 tempest-VolumeQuotasAdminTestJSON-622217377 None] Transfer volume completed successfully. Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Creating offline snapshot 20d0e607-b98e-4132-9933-0d7659802d83 of volume 6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f4896-8ce6-4e92-b6dc-1b59ccc8d28a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:10 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b Apr 08 15:51:10 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Acquiring lock "cinder-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "cinder-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Acquiring lock "cinder-quobyte-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "cinder-quobyte-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a2010-a117-48b4-be22-5deb9a4a45e9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:10 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 Apr 08 15:51:10 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:10 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b" returned: 0 in 0.789s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:10 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 1G Apr 08 15:51:10 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:11 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" returned: 0 in 0.734s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:11 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247 Apr 08 15:51:11 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Flow 'volume_create_manager' (92967152-cf59-4e36-a460-3ecbd230c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0605f2c9-c55b-43f1-aa1a-927c4c043823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0605f2c9-c55b-43f1-aa1a-927c4c043823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2120947832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138b5f73-71c4-4172-bed1-ae6436888a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db5c1367eb7432ca525108772e1f1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:11Z,use_quota=True,user_id='7b9a9004f2df433fa61b643e37c9506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65155d12-e390-4c58-a7b3-d76015b776fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65155d12-e390-4c58-a7b3-d76015b776fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054792dc-40b8-4c13-a3f2-d951d971341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054792dc-40b8-4c13-a3f2-d951d971341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138b5f73-71c4-4172-bed1-ae6436888a62', 'volume_name': 'volume-138b5f73-71c4-4172-bed1-ae6436888a62', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bae514-1ead-4c1a-a204-3d46a7fdbc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bae514-1ead-4c1a-a204-3d46a7fdbc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a3457a-56f2-4ce6-889e-e7e21c5d3b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:11 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Volume 138b5f73-71c4-4172-bed1-ae6436888a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138b5f73-71c4-4172-bed1-ae6436888a62', 'volume_size': 1} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:11 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 1G" returned: 0 in 0.758s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6692455a-4600-4a25-b618-9b6eae06e10b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:11 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6692455a-4600-4a25-b618-9b6eae06e10b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 Apr 08 15:51:11 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:11 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" returned: 0 in 0.575s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "cinder-quobyte-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247" released by "delete_volume" :: held 1.344s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Created reservations ['b0286d46-e87f-474d-9e02-c87c928e6e86', '43c29748-1972-4f3c-8068-02dd760527e4', '332cc564-1bba-4f93-a8f7-bf0bcc58ac88', 'c0f07bdf-ef99-4916-ba9f-99a2ee5668de'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:11 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:11 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:12 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6692455a-4600-4a25-b618-9b6eae06e10b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83" returned: 0 in 0.531s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:12 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 is being set with open permissions: ugo+rw Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:12 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 Apr 08 15:51:12 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:12 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.570s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Deleted volume successfully. Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1d1c9641-8c4f-4a97-8c47-25978a8b6093 tempest-VolumeQuotasAdminTestJSON-791523828 None] Lock "cinder-1c6f406d-2ca3-4dc3-8ed2-2bfcdc975247-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:12 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83" returned: 0 in 0.460s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:12 devstack sudo[85719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info Apr 08 15:51:12 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:13 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:13 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info is being set with open permissions: ugo+rw Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:13 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info Apr 08 15:51:13 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:13 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.info" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2120947832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138b5f73-71c4-4172-bed1-ae6436888a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db5c1367eb7432ca525108772e1f1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:11Z,use_quota=True,user_id='7b9a9004f2df433fa61b643e37c9506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Creating volume 138b5f73-71c4-4172-bed1-ae6436888a62 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:13 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:13 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 1073741824 Apr 08 15:51:13 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-bd496d11-b0c0-4f6e-b3d4-6f60f1abe57c req-8fbaf471-6355-4c7f-ba08-f948ac51566a tempest-VolumesSnapshotsTestJSON-2118744014 None] Create snapshot completed successfully Apr 08 15:51:14 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 1073741824" returned: 0 in 0.581s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:14 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 Apr 08 15:51:14 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:14 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62" returned: 0 in 0.511s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a3457a-56f2-4ce6-889e-e7e21c5d3b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138b5f73-71c4-4172-bed1-ae6436888a62', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa9fb8-788e-402a-a621-1266502610e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "cinder-20d0e607-b98e-4132-9933-0d7659802d83-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:14 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Volume volume-138b5f73-71c4-4172-bed1-ae6436888a62 (138b5f73-71c4-4172-bed1-ae6436888a62): created successfully Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa9fb8-788e-402a-a621-1266502610e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Flow 'volume_create_manager' (92967152-cf59-4e36-a460-3ecbd230c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-20d0e607-b98e-4132-9933-0d7659802d83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a5679de7-b96d-44ce-bd57-5edea931e0cf tempest-VolumeQuotasNegativeTestJSON-223987701 None] Created volume successfully. Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "cinder-quobyte-20d0e607-b98e-4132-9933-0d7659802d83" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-20d0e607-b98e-4132-9933-0d7659802d83" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Deleting offline snapshot 20d0e607-b98e-4132-9933-0d7659802d83 of volume 6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] snapshot_file for this snap is: volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b7399-5a38-4d5e-8f43-26c2137d2a8a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:15 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 Apr 08 15:51:15 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:15 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83" returned: 0 in 0.550s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6692455a-4600-4a25-b618-9b6eae06e10b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:15 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0299b9b-29ad-408c-9bd5-7524077c037d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:15 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b Apr 08 15:51:15 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:16 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b" returned: 0 in 0.789s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:16 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 Apr 08 15:51:16 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Acquiring lock "cinder-138b5f73-71c4-4172-bed1-ae6436888a62-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "cinder-138b5f73-71c4-4172-bed1-ae6436888a62-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Acquiring lock "cinder-quobyte-138b5f73-71c4-4172-bed1-ae6436888a62" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "cinder-quobyte-138b5f73-71c4-4172-bed1-ae6436888a62" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1500d-a1ff-425f-b93c-e2e7b44a3636]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:16 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 Apr 08 15:51:16 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:17 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83" returned: 0 in 0.833s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:17 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83 Apr 08 15:51:17 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:17 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62" returned: 0 in 0.645s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:17 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62 Apr 08 15:51:17 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:17 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b.20d0e607-b98e-4132-9933-0d7659802d83" returned: 0 in 0.540s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-20d0e607-b98e-4132-9933-0d7659802d83" released by "_delete_snapshot" :: held 2.812s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" released by "delete_snapshot" :: held 2.827s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Flow 'volume_create_manager' (a4c0e2ee-8b82-4725-b91b-c74adcd37ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:17 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9406724-fdb0-4ca7-8fc4-52f26f6d2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.quota [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Created reservations ['e3329158-ca02-4c1c-be72-ec1811afa37e', 'f8aa79ad-db7e-4359-9bb6-a68a1608dc6d', 'a317ce4d-5750-4112-8bdb-8c36b2b51ec2', 'e1d9a5f9-2876-487c-8c63-12eea25eaabe'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-138b5f73-71c4-4172-bed1-ae6436888a62" returned: 0 in 0.640s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9406724-fdb0-4ca7-8fc4-52f26f6d2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-392296821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bcd441-51b8-4dbd-9f0d-510eece637ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af52ac2de9b4186933dde91704e6e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:18Z,use_quota=True,user_id='26f998e98aa6426ea785f807f2a4a94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d208ee41-e5eb-437a-b19e-3fb65e2b577b),volume_type_id=d208ee41-e5eb-437a-b19e-3fb65e2b577b)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7356a67b-c281-4e90-aaea-f6cf19376f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7356a67b-c281-4e90-aaea-f6cf19376f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2900b787-b43f-41eb-89e3-03b9b7b4eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2900b787-b43f-41eb-89e3-03b9b7b4eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bcd441-51b8-4dbd-9f0d-510eece637ac', 'volume_name': 'volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf64d8f7-96f8-449a-8897-ca9c4f72dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf64d8f7-96f8-449a-8897-ca9c4f72dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017e5bb1-9a44-42e3-8cef-5b01cf3ae4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:17 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Volume e6bcd441-51b8-4dbd-9f0d-510eece637ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac', 'volume_size': 1} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-392296821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bcd441-51b8-4dbd-9f0d-510eece637ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af52ac2de9b4186933dde91704e6e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:18Z,use_quota=True,user_id='26f998e98aa6426ea785f807f2a4a94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d208ee41-e5eb-437a-b19e-3fb65e2b577b),volume_type_id=d208ee41-e5eb-437a-b19e-3fb65e2b577b)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Creating volume e6bcd441-51b8-4dbd-9f0d-510eece637ac {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:17 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Delete snapshot completed successfully. Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "cinder-quobyte-138b5f73-71c4-4172-bed1-ae6436888a62" released by "delete_volume" :: held 1.374s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-5b8ab423-1e69-4349-a4c3-e754a7008c1f req-f2813b1c-9de0-46aa-aaa3-126403d785ae tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-20d0e607-b98e-4132-9933-0d7659802d83-delete_snapshot" released by "delete_snapshot" :: held 3.092s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:17 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac 1073741824 Apr 08 15:51:17 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:17 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Created reservations ['4acd22ae-89c5-47b5-ae42-9bd02a7e03bb', 'f4b67691-fe96-44af-b7b3-942adc070068', '4824532c-78ae-4a7e-be68-acac573122c2', '5a4e9e5e-d5ec-4a47-a401-3e79adb8f426'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:18 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:18 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "cinder-6692455a-4600-4a25-b618-9b6eae06e10b-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-6692455a-4600-4a25-b618-9b6eae06e10b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee3e8d-a433-469e-8b78-7e05a1c25e26]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:18 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b Apr 08 15:51:18 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:18 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac 1073741824" returned: 0 in 0.557s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:18 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac Apr 08 15:51:18 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:18 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Deleted volume successfully. Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-655462b1-828b-4958-ba40-dda11bf4a55f tempest-VolumeQuotasNegativeTestJSON-223987701 None] Lock "cinder-138b5f73-71c4-4172-bed1-ae6436888a62-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:18 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b" returned: 0 in 0.537s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:18 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b Apr 08 15:51:18 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:19 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac" returned: 0 in 0.687s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017e5bb1-9a44-42e3-8cef-5b01cf3ae4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb666f62-6f73-4e14-98b8-443dca4442cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:19 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Volume volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac (e6bcd441-51b8-4dbd-9f0d-510eece637ac): created successfully Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb666f62-6f73-4e14-98b8-443dca4442cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Flow 'volume_create_manager' (a4c0e2ee-8b82-4725-b91b-c74adcd37ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-67b77945-9c0b-4c0e-bc0d-f9099a44a0d2 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Created volume successfully. Apr 08 15:51:19 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6692455a-4600-4a25-b618-9b6eae06e10b" returned: 0 in 0.621s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-quobyte-6692455a-4600-4a25-b618-9b6eae06e10b" released by "delete_volume" :: held 1.192s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.quota [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Created reservations ['608eda7b-f87f-419f-92b5-35bb0f23bc0a', '6e9646d8-638f-45d2-a8b4-2e8b648d8c0c', '9cdc0e59-20cf-44ed-a726-1ca8612edb70', '5ad529c4-bc02-4c71-9bc5-5ddd2add8e10'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:19 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:19 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:20 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.613s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG cinder.manager [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Deleted volume successfully. Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-0da01591-ed25-4b49-aadb-0e402fda33fd req-4a04a410-1c5b-460a-8ce1-a0cfe54c2187 tempest-VolumesSnapshotsTestJSON-2118744014 None] Lock "cinder-6692455a-4600-4a25-b618-9b6eae06e10b-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:20 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:20 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:21 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.715s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6187021d-c921-42b7-8056-2cec800edb76 tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Retype volume completed successfully. Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:21 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:21 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "cinder-e6bcd441-51b8-4dbd-9f0d-510eece637ac-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "cinder-e6bcd441-51b8-4dbd-9f0d-510eece637ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "cinder-quobyte-e6bcd441-51b8-4dbd-9f0d-510eece637ac" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "cinder-quobyte-e6bcd441-51b8-4dbd-9f0d-510eece637ac" acquired by "delete_volume" :: waited 0.028s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[489735b8-04b6-48f6-9e28-f99d193ddba5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:21 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac Apr 08 15:51:21 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:22 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.606s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:22 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac" returned: 0 in 0.675s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:22 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac Apr 08 15:51:22 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:23 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e6bcd441-51b8-4dbd-9f0d-510eece637ac" returned: 0 in 0.756s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "cinder-quobyte-e6bcd441-51b8-4dbd-9f0d-510eece637ac" released by "delete_volume" :: held 1.481s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:23 devstack cinder-volume[82216]: WARNING cinder.quota [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:51:23 devstack cinder-volume[82216]: WARNING cinder.quota [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Created reservations ['ba137a71-2486-4fa4-a11a-f686cb69271f', 'aac259a6-e21c-498c-83c4-d798d6b4b8ff', '23f1e8c6-9636-43df-b707-ded8e6ce9854', '8b41ec27-16c2-4ad4-9837-583a545c28bb'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:23 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:23 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:23 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.523s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Deleted volume successfully. Apr 08 15:51:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-02882ab2-96f7-44cd-aea4-c3bbe03319bf tempest-VolumeRetypeWithoutMigrationTest-524417105 None] Lock "cinder-e6bcd441-51b8-4dbd-9f0d-510eece637ac-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Flow 'volume_create_manager' (ae7b986e-d97a-4959-9f7f-e0e2020d946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461d4834-e067-4f7a-82c8-cddf4ba7ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461d4834-e067-4f7a-82c8-cddf4ba7ad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1846616780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c6ea81-7387-4248-8a5a-c7efccb7b6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56850dd3109f4c25a62800a5f1f821db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:30Z,use_quota=True,user_id='75089b4a8bd74389993bbbc940ed9b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c663750e-5989-4ac4-a65c-91188b2495aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c663750e-5989-4ac4-a65c-91188b2495aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c6d21f-08ce-40b2-997f-f0c0acf320ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c6d21f-08ce-40b2-997f-f0c0acf320ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c6ea81-7387-4248-8a5a-c7efccb7b6d3', 'volume_name': 'volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74396242-acb1-4a73-8d73-10b7ec481c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74396242-acb1-4a73-8d73-10b7ec481c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b247cd-3f48-4100-83d8-07255f30ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Volume e0c6ea81-7387-4248-8a5a-c7efccb7b6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3', 'volume_size': 1} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1846616780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c6ea81-7387-4248-8a5a-c7efccb7b6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56850dd3109f4c25a62800a5f1f821db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:30Z,use_quota=True,user_id='75089b4a8bd74389993bbbc940ed9b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Creating volume e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:30 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:30 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 1073741824 Apr 08 15:51:30 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:30 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 1073741824" returned: 0 in 0.568s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:31 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 Apr 08 15:51:31 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:31 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b247cd-3f48-4100-83d8-07255f30ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00abcee-21d6-4d08-931a-8b5758621ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Volume volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 (e0c6ea81-7387-4248-8a5a-c7efccb7b6d3): created successfully Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00abcee-21d6-4d08-931a-8b5758621ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Flow 'volume_create_manager' (ae7b986e-d97a-4959-9f7f-e0e2020d946b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e49560b8-3cad-4e46-bce7-7b1b338c1c58 tempest-VolumesServicesTestJSON-2094141371 None] Created volume successfully. Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Acquiring lock "cinder-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "cinder-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Acquiring lock "cinder-quobyte-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "cinder-quobyte-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ca9f8-62d0-4f58-aeb1-872d2954f01b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:32 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 Apr 08 15:51:32 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:33 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" returned: 0 in 1.139s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:33 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3 Apr 08 15:51:33 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:34 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" returned: 0 in 0.774s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "cinder-quobyte-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3" released by "delete_volume" :: held 1.943s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Created reservations ['12922dc8-0b15-4437-8c69-ca85283efe4f', '3d301584-db4f-41c1-9bdc-a41142be0096', '4de22590-60a1-4afe-91cb-9cc48699a1a5', '77feaec8-2920-4676-a887-afb405f6c5da'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:34 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:34 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:35 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Flow 'volume_create_manager' (67d3cd19-be56-471d-8d72-c512a89c9400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d85277c-3457-4447-bd2e-f4b20b7ee7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.962s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d85277c-3457-4447-bd2e-f4b20b7ee7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:35Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a881f3a86471d8e8a42b7be582079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:36Z,use_quota=True,user_id='7056d1dc8e06478f83455a6160310c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf45fd-6359-41c8-9e22-3dae75d97207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf45fd-6359-41c8-9e22-3dae75d97207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88412e1a-7db2-4ace-9124-f9cee9702b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.image.glance [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Creating Keystone auth plugin from conf {{(pid=82216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 15:51:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Deleted volume successfully. Apr 08 15:51:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a7f330b2-4e13-4dae-af10-a16a8432107f tempest-VolumesServicesTestJSON-2094141371 None] Lock "cinder-e0c6ea81-7387-4248-8a5a-c7efccb7b6d3-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88412e1a-7db2-4ace-9124-f9cee9702b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a', 'volume_name': 'volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa90814-92e0-4ef3-9b85-9a4439a4da33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa90814-92e0-4ef3-9b85-9a4439a4da33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bb15d-7b81-4c9f-b56d-2469a2865d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:36 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Trying to clone 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]). {{(pid=82216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 15:51:36 devstack cinder-volume[82216]: INFO cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Image download 20.69 MB at 20.69 MB/s Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b88a596-1994-42e1-a4dd-9cd8de077772]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:36 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD Apr 08 15:51:36 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:37 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:37 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 is fetched for user 7056d1dc8e06478f83455a6160310c32. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 15:51:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da8831-4545-4a55-8c0e-76a71afc0fc4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:37 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD Apr 08 15:51:37 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:38 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD" returned: 0 in 1.037s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:35Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a881f3a86471d8e8a42b7be582079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:36Z,use_quota=True,user_id='7056d1dc8e06478f83455a6160310c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Creating volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:38 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:38 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1073741824 Apr 08 15:51:38 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:39 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1073741824" returned: 0 in 0.937s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:39 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:39 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:40 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 0.648s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Attempting download of e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fc5ff-e52b-46c7-bdb0-c2b16929730f]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:40 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj Apr 08 15:51:40 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:40 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj" returned: 0 in 0.617s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:41 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj Apr 08 15:51:41 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (11d4391b-0e2b-4ca4-a214-622fafe0b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e8a653-d489-4b3c-8fa2-3a3a322573ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e8a653-d489-4b3c-8fa2-3a3a322573ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-634342250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f914bdf3-9952-4b99-908d-04c190fc109e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bdf233e75e418285174d5d904fd863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:42Z,use_quota=True,user_id='e6fd4e447c0a466fbd7dd9aec60828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5191f627-895a-4085-bbdb-cefa65eecb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5191f627-895a-4085-bbdb-cefa65eecb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c4666-ce69-4308-aacb-fbb4449ee811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c4666-ce69-4308-aacb-fbb4449ee811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f914bdf3-9952-4b99-908d-04c190fc109e', 'volume_name': 'volume-f914bdf3-9952-4b99-908d-04c190fc109e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467e559-dc64-465d-bfbc-c2956c395cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467e559-dc64-465d-bfbc-c2956c395cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb28a99c-da59-4a38-b5e2-30c71a89b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Volume f914bdf3-9952-4b99-908d-04c190fc109e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f914bdf3-9952-4b99-908d-04c190fc109e', 'volume_size': 1} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-634342250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f914bdf3-9952-4b99-908d-04c190fc109e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bdf233e75e418285174d5d904fd863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:42Z,use_quota=True,user_id='e6fd4e447c0a466fbd7dd9aec60828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Creating volume f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:41 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:41 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e 1073741824 Apr 08 15:51:41 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Flow 'volume_create_manager' (ed152f89-3846-48a6-8906-622c63574b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b991693e-f323-4a7b-8ae5-922e9bee2c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b991693e-f323-4a7b-8ae5-922e9bee2c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-147721830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930e77fb-d58d-4d1a-869d-fcb3c41fd2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da4184086b342d4b46e8c298e9cf890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:42Z,use_quota=True,user_id='9346b42b516a47998e8a39c1796809e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb652e9-ed3f-47fc-9378-340a7e953c46),volume_type_id=6bb652e9-ed3f-47fc-9378-340a7e953c46)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7bed4e-989f-4225-9474-89de95c6640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7bed4e-989f-4225-9474-89de95c6640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8af8ef-b2a6-45f2-ad2d-6c4cecc1246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8af8ef-b2a6-45f2-ad2d-6c4cecc1246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930e77fb-d58d-4d1a-869d-fcb3c41fd2d7', 'volume_name': 'volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00e8d5b-14b6-46c2-b0ec-89254f8132b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00e8d5b-14b6-46c2-b0ec-89254f8132b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:41 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffe6ed7-889f-4548-a513-1ab2d838aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Volume 930e77fb-d58d-4d1a-869d-fcb3c41fd2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7', 'volume_size': 1} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj" returned: 1 in 0.910s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ocf2u_oj' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5cb291-7b0f-47eb-ad11-e044883f5933]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:41 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD Apr 08 15:51:41 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:42 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e 1073741824" returned: 0 in 0.767s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:42 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:51:42 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:42 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD" returned: 0 in 0.655s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:42 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] e5804f13-1c8e-4c0f-8b39-f65c9607d678 was qcow2, converting to raw {{(pid=82216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 15:51:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:42 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:42 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:43 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.544s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-147721830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930e77fb-d58d-4d1a-869d-fcb3c41fd2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da4184086b342d4b46e8c298e9cf890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:42Z,use_quota=True,user_id='9346b42b516a47998e8a39c1796809e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb652e9-ed3f-47fc-9378-340a7e953c46),volume_type_id=6bb652e9-ed3f-47fc-9378-340a7e953c46)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Creating volume 930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:43 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb28a99c-da59-4a38-b5e2-30c71a89b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f914bdf3-9952-4b99-908d-04c190fc109e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eee9892-c65f-4cac-86f6-fef8bebecf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:43 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 1073741824 Apr 08 15:51:43 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:43 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Volume volume-f914bdf3-9952-4b99-908d-04c190fc109e (f914bdf3-9952-4b99-908d-04c190fc109e): created successfully Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eee9892-c65f-4cac-86f6-fef8bebecf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (11d4391b-0e2b-4ca4-a214-622fafe0b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3a4a3418-cf4e-4d2b-80d9-1ec08a2ef5fd tempest-VolumesDeleteCascade-1824486233 None] Created volume successfully. Apr 08 15:51:43 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 1.082s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_evwmq0rodevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:51:43 devstack cinder-volume[82216]: INFO cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Converted 112.00 MB image at 103.38 MB/s Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:43 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1G Apr 08 15:51:43 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:43 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 1073741824" returned: 0 in 0.825s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:44 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 Apr 08 15:51:44 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:44 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a 1G" returned: 0 in 0.725s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa4027-c6dc-46d3-b51e-1f62bd28783d]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:44 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.478s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:44 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:44 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffe6ed7-889f-4548-a513-1ab2d838aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dca8e1-e0c5-41e6-890a-7e89a8fcfa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Creating offline snapshot 37619b5b-9366-4119-9252-38568a3d2675 of volume f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa888543-09c6-41e5-9ae2-f63f86971b0d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:44 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Volume volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 (930e77fb-d58d-4d1a-869d-fcb3c41fd2d7): created successfully Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dca8e1-e0c5-41e6-890a-7e89a8fcfa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Flow 'volume_create_manager' (ed152f89-3846-48a6-8906-622c63574b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-10e22bde-2ffd-434a-a4d5-8e96b246831c tempest-VolumeTypesAccessTest-1359787541 None] Created volume successfully. Apr 08 15:51:44 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:51:44 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Acquiring lock "cinder-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "cinder-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:45 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 0.728s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Acquiring lock "cinder-quobyte-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "cinder-quobyte-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894caab-18df-44ce-9f17-34177caa5030]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:45 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:45 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:45 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 Apr 08 15:51:45 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:45 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.801s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:45 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 1G Apr 08 15:51:45 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Flow 'volume_create_manager' (f9c6e572-96f4-4fd6-9d7a-5584c374daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966190ec-28c6-4e33-92dd-21e325b96408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:45 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966190ec-28c6-4e33-92dd-21e325b96408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2105569107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb508de1-53f5-4cac-b187-8fee535cd508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfe545ba39648bc8ec95b78b0954ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:46Z,use_quota=True,user_id='deb147b57d514dbe9421016e6cc8309a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3895ac-5d29-479a-bc23-74712f144929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3895ac-5d29-479a-bc23-74712f144929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04344c9-15bd-4f6d-84b3-3f011f6f1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04344c9-15bd-4f6d-84b3-3f011f6f1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb508de1-53f5-4cac-b187-8fee535cd508', 'volume_name': 'volume-fb508de1-53f5-4cac-b187-8fee535cd508', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a791f902-8dd0-4691-94f5-8684318331bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a791f902-8dd0-4691-94f5-8684318331bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30128d85-0793-417e-b877-ab285de0b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:45 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Volume fb508de1-53f5-4cac-b187-8fee535cd508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb508de1-53f5-4cac-b187-8fee535cd508', 'volume_size': 1} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 1 in 0.835s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Downloaded image e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a successfully. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 for user 7056d1dc8e06478f83455a6160310c32 is deleted. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Marking volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a as bootable. {{(pid=82216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Copying metadata from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 to 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a. {{(pid=82216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 15:51:45 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Creating volume glance metadata for volume 896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a backed by image e5804f13-1c8e-4c0f-8b39-f65c9607d678 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bb15d-7b81-4c9f-b56d-2469a2865d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847b1522-18bb-4fa2-9a51-b648241db4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:46 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:46 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Volume volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a (896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a): created successfully Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847b1522-18bb-4fa2-9a51-b648241db4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Flow 'volume_create_manager' (67d3cd19-be56-471d-8d72-c512a89c9400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 1G" returned: 0 in 0.679s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:46 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-48d44e70-1380-4f24-9eb1-51a57349204f tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Created volume successfully. Apr 08 15:51:46 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:46 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:46 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" returned: 0 in 0.902s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:46 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7 Apr 08 15:51:46 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:46 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" returned: 0 in 0.420s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "cinder-quobyte-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7" released by "delete_volume" :: held 1.347s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:46 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:46 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 is being set with open permissions: ugo+rw Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:46 devstack cinder-volume[82216]: WARNING cinder.quota [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-520525050 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-520525050, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:51:46 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:46 devstack cinder-volume[82216]: WARNING cinder.quota [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-520525050 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-520525050, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:51:46 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Created reservations ['ac539ea2-224e-4654-a04f-63c710a940c0', '71ee870b-c687-4f0f-9993-7ed5de90c050', '02e42118-3d6d-4ba8-8391-96ce4131d2bb', '2c8d4905-63b5-4c19-a2b0-1d15f048bd37'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:46 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:51:46 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:47 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.454s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:47 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info Apr 08 15:51:47 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:47 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:51:47 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Deleted volume successfully. Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bdfa6e30-4c8a-46d5-b656-080eb267ff7c tempest-VolumeTypesAccessTest-1359787541 None] Lock "cinder-930e77fb-d58d-4d1a-869d-fcb3c41fd2d7-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:47 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info" returned: 0 in 0.482s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:47 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info is being set with open permissions: ugo+rw Apr 08 15:51:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:47 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info Apr 08 15:51:47 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:48 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.info" returned: 0 in 0.568s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.143s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2105569107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb508de1-53f5-4cac-b187-8fee535cd508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfe545ba39648bc8ec95b78b0954ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:46Z,use_quota=True,user_id='deb147b57d514dbe9421016e6cc8309a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Creating volume fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:48 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:48 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 1073741824 Apr 08 15:51:48 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:48 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4152c7df-9b8d-4352-a5aa-38e7c1d01343 tempest-VolumesDeleteCascade-1824486233 None] Create snapshot completed successfully Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:48 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 1073741824" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:48 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 Apr 08 15:51:48 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:49 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508" returned: 0 in 0.510s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.908s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30128d85-0793-417e-b877-ab285de0b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb508de1-53f5-4cac-b187-8fee535cd508', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1e19fe-01b9-4da2-af75-6f6794544274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Volume volume-fb508de1-53f5-4cac-b187-8fee535cd508 (fb508de1-53f5-4cac-b187-8fee535cd508): created successfully Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1e19fe-01b9-4da2-af75-6f6794544274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Flow 'volume_create_manager' (f9c6e572-96f4-4fd6-9d7a-5584c374daad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d410da5-a0a1-4209-bee4-49607e794a68]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9e4aa117-fa08-47c5-872b-bfe040c2c9d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Created volume successfully. Apr 08 15:51:49 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:49 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:49 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 0.562s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:49 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:51:49 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:50 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 1 in 0.585s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.183s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.027s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Creating offline snapshot e6215ae9-5864-4ff3-8dc8-af2826a4654d of volume f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965a33c-8d11-408f-bc28-f430c92fedf9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8', 'name': 'volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d9b223c-7f55-4400-9eb9-e65bb64cfa22', 'enforce_multipath': True} {{(pid=82216) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 15:51:50 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-53039adf-0ac8-41f2-b907-9263ac94c750 req-dc6e05ff-abbd-4ec9-9930-a46aa156c337 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] attachment_update completed successfully. Apr 08 15:51:50 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:50 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:51 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f914bdf3-9952-4b99-908d-04c190fc109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:51 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d 1G Apr 08 15:51:51 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:51 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d 1G" returned: 0 in 0.559s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:51 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:51:51 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:52 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.542s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:52 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d is being set with open permissions: ugo+rw Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:52 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:51:52 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:52 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.498s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.425s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Creating offline snapshot 215ecf21-f81c-49b0-af3e-194dddc54aef of volume fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b6422b-f0b1-4078-bed6-fd88c7d4b320]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-49ed23da-28fc-45a0-b857-039c1e3bce63 tempest-VolumesDeleteCascade-1824486233 None] Create snapshot completed successfully Apr 08 15:51:52 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 Apr 08 15:51:52 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:53 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508" returned: 0 in 0.525s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:53 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef 1G Apr 08 15:51:53 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-f914bdf3-9952-4b99-908d-04c190fc109e-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-f914bdf3-9952-4b99-908d-04c190fc109e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Performing cascade delete. {{(pid=82216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-37619b5b-9366-4119-9252-38568a3d2675-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-37619b5b-9366-4119-9252-38568a3d2675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-37619b5b-9366-4119-9252-38568a3d2675" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-37619b5b-9366-4119-9252-38568a3d2675" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Deleting offline snapshot 37619b5b-9366-4119-9252-38568a3d2675 of volume f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] snapshot_file for this snap is: volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba2f23e-6bfc-44c3-9a1d-b8f92ad83df4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:53 devstack sudo[86134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:53 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:53 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef 1G" returned: 0 in 0.718s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb508de1-53f5-4cac-b187-8fee535cd508 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:53 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb508de1-53f5-4cac-b187-8fee535cd508 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef Apr 08 15:51:53 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:54 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.654s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f914bdf3-9952-4b99-908d-04c190fc109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171354f-48cb-4c1b-8177-a778b42de709]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:54 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb508de1-53f5-4cac-b187-8fee535cd508 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef" returned: 0 in 0.522s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:54 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef is being set with open permissions: ugo+rw Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:54 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef Apr 08 15:51:54 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:54 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:51:54 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:54 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:54 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.530s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500921c-50e8-4720-9af7-862c41e9b34c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:54 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info Apr 08 15:51:54 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:55 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:51:55 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (362f918b-505c-4745-8e16-0bbe228bd6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed567fb7-c596-4a0e-8712-1b923f16abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed567fb7-c596-4a0e-8712-1b923f16abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1985140392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e602172d-911a-4b31-bad5-7a9dfa1650fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:55Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd178c9d-c97d-448d-ab8c-1a1b72bb9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd178c9d-c97d-448d-ab8c-1a1b72bb9f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f0eae3-9672-428e-8cb9-316ae0785683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f0eae3-9672-428e-8cb9-316ae0785683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e602172d-911a-4b31-bad5-7a9dfa1650fe', 'volume_name': 'volume-e602172d-911a-4b31-bad5-7a9dfa1650fe', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ba5e98-ee5f-4d67-9e63-ff63727ba192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ba5e98-ee5f-4d67-9e63-ff63727ba192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f10e16a-3c53-4b41-ab1b-aba1efd0f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:55 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Volume e602172d-911a-4b31-bad5-7a9dfa1650fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e602172d-911a-4b31-bad5-7a9dfa1650fe', 'volume_size': 1} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:55 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info" returned: 0 in 0.689s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:55 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info is being set with open permissions: ugo+rw Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:55 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info Apr 08 15:51:55 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:55 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.816s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f914bdf3-9952-4b99-908d-04c190fc109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41768def-ca8a-43a9-b414-41ced80fc2e8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:55 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:55 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:56 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.info" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.488s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1985140392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e602172d-911a-4b31-bad5-7a9dfa1650fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:55Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Creating volume e602172d-911a-4b31-bad5-7a9dfa1650fe {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:56 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:56 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe 1073741824 Apr 08 15:51:56 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:56 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1203b7d4-96ba-411f-b0fa-3f39e41bc947 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Create snapshot completed successfully Apr 08 15:51:56 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.545s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f914bdf3-9952-4b99-908d-04c190fc109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f5e228-6647-4f4e-91ad-b686f0ae560c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:56 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:51:56 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "cinder-215ecf21-f81c-49b0-af3e-194dddc54aef-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-215ecf21-f81c-49b0-af3e-194dddc54aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "cinder-quobyte-215ecf21-f81c-49b0-af3e-194dddc54aef" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-215ecf21-f81c-49b0-af3e-194dddc54aef" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Deleting offline snapshot 215ecf21-f81c-49b0-af3e-194dddc54aef of volume fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] snapshot_file for this snap is: volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf925e1c-b674-4c83-b107-6ac1f3a13304]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:56 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef Apr 08 15:51:57 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:57 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe 1073741824" returned: 0 in 0.922s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:57 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe Apr 08 15:51:57 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:57 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.752s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:57 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:57 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:57 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef" returned: 0 in 0.604s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb508de1-53f5-4cac-b187-8fee535cd508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6b1fa6-c338-4d0e-a549-bc17fd981f4e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:57 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe" returned: 0 in 0.546s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f10e16a-3c53-4b41-ab1b-aba1efd0f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e602172d-911a-4b31-bad5-7a9dfa1650fe', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7bc010-c223-4d39-aa48-61a6c34a518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:57 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Volume volume-e602172d-911a-4b31-bad5-7a9dfa1650fe (e602172d-911a-4b31-bad5-7a9dfa1650fe): created successfully Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7bc010-c223-4d39-aa48-61a6c34a518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (362f918b-505c-4745-8e16-0bbe228bd6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b2c27668-cac0-496b-ad54-6039dd5d95d2 tempest-VolumesListAdminTestJSON-226340017 None] Created volume successfully. Apr 08 15:51:57 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 Apr 08 15:51:57 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:57 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.585s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:57 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675 Apr 08 15:51:57 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:58 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508" returned: 0 in 0.670s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:58 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef Apr 08 15:51:58 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:58 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.37619b5b-9366-4119-9252-38568a3d2675" returned: 0 in 0.562s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d -F qcow2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:58 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d -F qcow2 Apr 08 15:51:58 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:58 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f914bdf3-9952-4b99-908d-04c190fc109e /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d -F qcow2" returned: 0 in 0.649s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-37619b5b-9366-4119-9252-38568a3d2675" released by "_delete_snapshot" :: held 5.207s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:58 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" released by "delete_snapshot" :: held 5.231s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef" returned: 0 in 0.778s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:58 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:51:59 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef Apr 08 15:51:59 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (1196a03e-c75b-4e8a-972f-e3e0d109eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e49003-4bed-403a-9e67-4c25726f733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e49003-4bed-403a-9e67-4c25726f733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-16801103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edbe6b6-314c-4618-96c2-25d544d9d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:59Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8663a7f2-2b5c-4ac4-8348-3e863b6546c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8663a7f2-2b5c-4ac4-8348-3e863b6546c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae078c91-b40e-427f-9d98-68efa887e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae078c91-b40e-427f-9d98-68efa887e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edbe6b6-314c-4618-96c2-25d544d9d0c9', 'volume_name': 'volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ebbe52-e1d2-4edb-9c70-a9a6504ec1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ebbe52-e1d2-4edb-9c70-a9a6504ec1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101d0781-5240-4faf-adcc-10627d529cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:51:59 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Volume 5edbe6b6-314c-4618-96c2-25d544d9d0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9', 'volume_size': 1} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-16801103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edbe6b6-314c-4618-96c2-25d544d9d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:51:59Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Creating volume 5edbe6b6-314c-4618-96c2-25d544d9d0c9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:51:59 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:59 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 1073741824 Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['e929820e-3f2d-4b2c-ad9c-941e582b98ed', 'fd4e8635-a046-477f-af69-e9f321837ff7', 'c0331de5-b07d-41b8-9bf2-d414b5a3bc45', 'b22e3a9a-d204-4312-a30a-bca350ca6fd8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:59 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Delete snapshot completed successfully. Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-37619b5b-9366-4119-9252-38568a3d2675-delete_snapshot" released by "delete_snapshot" :: held 5.510s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-e6215ae9-5864-4ff3-8dc8-af2826a4654d-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-e6215ae9-5864-4ff3-8dc8-af2826a4654d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-e6215ae9-5864-4ff3-8dc8-af2826a4654d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-e6215ae9-5864-4ff3-8dc8-af2826a4654d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Deleting offline snapshot e6215ae9-5864-4ff3-8dc8-af2826a4654d of volume f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] snapshot_file for this snap is: volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d391f-e68a-4b95-95c0-59652b7bb8d8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:59 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:51:59 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:59 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508.215ecf21-f81c-49b0-af3e-194dddc54aef" returned: 0 in 0.484s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-215ecf21-f81c-49b0-af3e-194dddc54aef" released by "_delete_snapshot" :: held 2.604s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" released by "delete_snapshot" :: held 2.640s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Created reservations ['bc8b8c38-b39e-41d1-88d6-70dce3eba423', '51f779f3-1dcd-4afc-aac4-9080770e1e1c', '76ce2663-419a-4778-8c49-1401d9ae7ba7', '68dc7e56-8a0c-4bbe-9639-1bb1737a3de5'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:51:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Delete snapshot completed successfully. Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7661fb8b-d9c1-4859-9b7d-417e7be0bc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-215ecf21-f81c-49b0-af3e-194dddc54aef-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:51:59 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 1073741824" returned: 0 in 0.690s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:59 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 Apr 08 15:51:59 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:51:59 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.550s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f914bdf3-9952-4b99-908d-04c190fc109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d45d0b-1038-486b-9f89-d309f6420368]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:51:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:51:59 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:51:59 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "cinder-fb508de1-53f5-4cac-b187-8fee535cd508-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-fb508de1-53f5-4cac-b187-8fee535cd508-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f8f510-ddb3-4d25-8c1c-6548293179dc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:00 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9" returned: 0 in 0.459s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101d0781-5240-4faf-adcc-10627d529cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265be6ee-a601-43d7-a670-42e52653abef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:00 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Volume volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 (5edbe6b6-314c-4618-96c2-25d544d9d0c9): created successfully Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265be6ee-a601-43d7-a670-42e52653abef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (1196a03e-c75b-4e8a-972f-e3e0d109eece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4cb98ddc-8c71-4836-a373-46a74eb82ce1 tempest-VolumesListAdminTestJSON-226340017 None] Created volume successfully. Apr 08 15:52:00 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 Apr 08 15:52:00 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:00 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.713s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:00 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:52:00 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:00 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508" returned: 0 in 0.733s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:00 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508 Apr 08 15:52:00 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:01 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.544s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:01 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d Apr 08 15:52:01 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (616372ff-703c-418f-9401-0ed90565ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ef62ef-9de3-4a86-b01d-9750c5054c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ef62ef-9de3-4a86-b01d-9750c5054c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91260600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b83d116-f1b5-4b7e-9097-80fdce318475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:01Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c20f60d-7db8-4a1a-b82c-81af261d65f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c20f60d-7db8-4a1a-b82c-81af261d65f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3d704-7573-4b6a-a119-7b4e8ff7bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3d704-7573-4b6a-a119-7b4e8ff7bf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b83d116-f1b5-4b7e-9097-80fdce318475', 'volume_name': 'volume-6b83d116-f1b5-4b7e-9097-80fdce318475', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f457c0aa-ed36-4fc7-a2c3-26e41f6ec72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f457c0aa-ed36-4fc7-a2c3-26e41f6ec72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd8d3e-3632-4519-9f9e-9be2a91fd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Volume 6b83d116-f1b5-4b7e-9097-80fdce318475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b83d116-f1b5-4b7e-9097-80fdce318475', 'volume_size': 1} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91260600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b83d116-f1b5-4b7e-9097-80fdce318475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97833468a294986867229501cf745d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:01Z,use_quota=True,user_id='3cc5c34e579b43d2b2ccd346e2e034ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Creating volume 6b83d116-f1b5-4b7e-9097-80fdce318475 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:01 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:01 devstack sudo[86273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 1073741824 Apr 08 15:52:01 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:01 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fb508de1-53f5-4cac-b187-8fee535cd508" returned: 0 in 0.647s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-quobyte-fb508de1-53f5-4cac-b187-8fee535cd508" released by "delete_volume" :: held 1.442s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:01 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e.e6215ae9-5864-4ff3-8dc8-af2826a4654d" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-e6215ae9-5864-4ff3-8dc8-af2826a4654d" released by "_delete_snapshot" :: held 2.371s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Created reservations ['fc0c1c63-7231-435c-9b1b-d85cde588001', 'abfda2ee-d6b6-4adf-aa41-61fb099e08d6', 'ca08f548-6b94-415d-8c51-dd6c94fc219e', '7d3bc226-86a7-48ba-a2f3-0c50e12727da'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" released by "delete_snapshot" :: held 2.392s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['af80aadd-7b7d-4c2b-acdc-f760b3093d4f', 'b207d5da-901e-432c-ba31-c193d1866e63', 'bc64f88c-53d9-4399-85ba-3f3f6dde4bb8', '31d75a2e-4ede-4c4d-9770-a394a3fe526e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:01 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:01 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Delete snapshot completed successfully. Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-e6215ae9-5864-4ff3-8dc8-af2826a4654d-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Snapshots deleted, issuing volume delete {{(pid=82216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9694c7-103b-4b67-9c09-b5544847c82e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:01 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:52:01 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:02 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 1073741824" returned: 0 in 0.668s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:02 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 Apr 08 15:52:02 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:02 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.609s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Deleted volume successfully. Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=146,cinder:UPDATE=149,cinder:DELETE=16,cinder:INSERT=60 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-596e69b4-1277-42de-b8e2-695b75e91f4f tempest-VolumeSnapshotQuotasNegativeTestJSON-614620840 None] Lock "cinder-fb508de1-53f5-4cac-b187-8fee535cd508-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:02 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.701s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:02 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e Apr 08 15:52:02 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:02 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475" returned: 0 in 0.582s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=119,cinder:UPDATE=153,cinder:INSERT=25,cinder:DELETE=9 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bd8d3e-3632-4519-9f9e-9be2a91fd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b83d116-f1b5-4b7e-9097-80fdce318475', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b754f83-7e7f-40f8-8da8-29f00cc2000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Volume volume-6b83d116-f1b5-4b7e-9097-80fdce318475 (6b83d116-f1b5-4b7e-9097-80fdce318475): created successfully Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b754f83-7e7f-40f8-8da8-29f00cc2000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Flow 'volume_create_manager' (616372ff-703c-418f-9401-0ed90565ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b9678fa5-8072-4aac-abc9-d60016ab4599 tempest-VolumesListAdminTestJSON-226340017 None] Created volume successfully. Apr 08 15:52:03 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f914bdf3-9952-4b99-908d-04c190fc109e" returned: 0 in 0.630s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-f914bdf3-9952-4b99-908d-04c190fc109e" released by "delete_volume" :: held 1.387s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['0779057f-0e70-40cd-a61c-ec74d0324056', '8d66a58d-3737-4ff7-b389-d96d57991512', '5d137575-b2fc-41bf-b068-5987ddf3405c', '144dbfef-9e1e-4769-ac27-08d186b84fcc'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:03 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:03 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (b7223fee-5a9a-4ba5-b0e2-ce39ecf7292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fbd9a3-d08f-4244-9743-db0ec6293267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fbd9a3-d08f-4244-9743-db0ec6293267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-32770431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf95f5d-97e3-470b-a699-cf61bbece270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bdf233e75e418285174d5d904fd863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:04Z,use_quota=True,user_id='e6fd4e447c0a466fbd7dd9aec60828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3819e4-93c3-4a26-86d0-47d1e1ea82d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3819e4-93c3-4a26-86d0-47d1e1ea82d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549bbe97-0832-4476-9b37-0eda663a1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549bbe97-0832-4476-9b37-0eda663a1d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf95f5d-97e3-470b-a699-cf61bbece270', 'volume_name': 'volume-abf95f5d-97e3-470b-a699-cf61bbece270', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18967077-36d5-4ff4-9ba8-c1e823fa989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18967077-36d5-4ff4-9ba8-c1e823fa989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930f685-f05a-4c45-a3af-d1ca3faab17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Volume abf95f5d-97e3-470b-a699-cf61bbece270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf95f5d-97e3-470b-a699-cf61bbece270', 'volume_size': 1} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-32770431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf95f5d-97e3-470b-a699-cf61bbece270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bdf233e75e418285174d5d904fd863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:04Z,use_quota=True,user_id='e6fd4e447c0a466fbd7dd9aec60828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Creating volume abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:03 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:03 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 1073741824 Apr 08 15:52:03 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:04 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.733s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Deleted volume successfully. Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8a27dfe2-b87b-4aec-a1d3-6a7bdcb65b82 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-f914bdf3-9952-4b99-908d-04c190fc109e-delete_volume" released by "delete_volume" :: held 10.480s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Flow 'volume_create_manager' (4c62c314-f3f3-48ca-bd81-3f157a22c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3651a9dd-e955-4ef7-b261-56b0e3392fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3651a9dd-e955-4ef7-b261-56b0e3392fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b05a07-c475-48bc-a956-7f266916b2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2379b789c4d3473c877731e341c0f68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:04Z,use_quota=True,user_id='7ae67599be4746fd8b57238a964a280a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc21491-7acd-4788-a822-bcf93ff2b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc21491-7acd-4788-a822-bcf93ff2b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf74fe9-7035-4ba2-a63c-10034a085c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf74fe9-7035-4ba2-a63c-10034a085c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b05a07-c475-48bc-a956-7f266916b2ec', 'volume_name': 'volume-45b05a07-c475-48bc-a956-7f266916b2ec', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2c0b14-4593-4cd5-928d-f1e0fd041721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2c0b14-4593-4cd5-928d-f1e0fd041721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8d9802-14e2-4cad-9590-9d9d325c96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Volume 45b05a07-c475-48bc-a956-7f266916b2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b05a07-c475-48bc-a956-7f266916b2ec', 'volume_size': 1} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:04 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 1073741824" returned: 0 in 0.689s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:04 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:04 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:05 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.486s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b05a07-c475-48bc-a956-7f266916b2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2379b789c4d3473c877731e341c0f68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:04Z,use_quota=True,user_id='7ae67599be4746fd8b57238a964a280a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Creating volume 45b05a07-c475-48bc-a956-7f266916b2ec {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:05 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930f685-f05a-4c45-a3af-d1ca3faab17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf95f5d-97e3-470b-a699-cf61bbece270', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec 1073741824 Apr 08 15:52:05 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b22d25-c1ab-4fe0-a8a1-bf2cd991fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Volume volume-abf95f5d-97e3-470b-a699-cf61bbece270 (abf95f5d-97e3-470b-a699-cf61bbece270): created successfully Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b22d25-c1ab-4fe0-a8a1-bf2cd991fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (b7223fee-5a9a-4ba5-b0e2-ce39ecf7292f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fa597cdd-5af8-4459-a54c-53a8fb29c82f tempest-VolumesDeleteCascade-1824486233 None] Created volume successfully. Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Flow 'volume_create_manager' (5cd40d0f-564a-4650-a933-8339bf7addb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37416881-bb89-4317-9d9f-0b94ba530de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37416881-bb89-4317-9d9f-0b94ba530de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-792701538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39f183c-fb37-46fb-819b-d70ac4daffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ad694dbdbc475dad002b2de9652be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:05Z,use_quota=True,user_id='dacb72bf03a244aa8261455ba8c5575c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae7fa16-c1c9-4741-9712-11787799ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae7fa16-c1c9-4741-9712-11787799ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906a9af-fa80-49f3-a991-50e2222914d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906a9af-fa80-49f3-a991-50e2222914d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39f183c-fb37-46fb-819b-d70ac4daffdc', 'volume_name': 'volume-e39f183c-fb37-46fb-819b-d70ac4daffdc', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7746a-1cf6-444c-ac8a-6f032232886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7746a-1cf6-444c-ac8a-6f032232886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bec65d1-8920-4a31-94b1-bd81cafff838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:05 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Volume e39f183c-fb37-46fb-819b-d70ac4daffdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39f183c-fb37-46fb-819b-d70ac4daffdc', 'volume_size': 1} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:05 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec 1073741824" returned: 0 in 0.487s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:05 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec Apr 08 15:52:05 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:06 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec" returned: 0 in 0.438s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-792701538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39f183c-fb37-46fb-819b-d70ac4daffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ad694dbdbc475dad002b2de9652be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:05Z,use_quota=True,user_id='dacb72bf03a244aa8261455ba8c5575c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Creating volume e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:06 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8d9802-14e2-4cad-9590-9d9d325c96cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b05a07-c475-48bc-a956-7f266916b2ec', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:06 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc 1073741824 Apr 08 15:52:06 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4601dd8c-1689-48f0-87e1-b25a126f7d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:06 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Volume volume-45b05a07-c475-48bc-a956-7f266916b2ec (45b05a07-c475-48bc-a956-7f266916b2ec): created successfully Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4601dd8c-1689-48f0-87e1-b25a126f7d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Flow 'volume_create_manager' (4c62c314-f3f3-48ca-bd81-3f157a22c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b72100f2-5858-4d06-b4ce-398a6e3c7bd0 tempest-VolumesListAdminTestJSON-1117150041 None] Created volume successfully. Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Acquiring lock "cinder-45b05a07-c475-48bc-a956-7f266916b2ec-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "cinder-45b05a07-c475-48bc-a956-7f266916b2ec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Acquiring lock "cinder-quobyte-45b05a07-c475-48bc-a956-7f266916b2ec" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "cinder-quobyte-45b05a07-c475-48bc-a956-7f266916b2ec" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a349fe3-278c-458f-b565-8b0e050bdaff]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-6b83d116-f1b5-4b7e-9097-80fdce318475-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-6b83d116-f1b5-4b7e-9097-80fdce318475-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-quobyte-6b83d116-f1b5-4b7e-9097-80fdce318475" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-6b83d116-f1b5-4b7e-9097-80fdce318475" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:06 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec Apr 08 15:52:06 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2275bec-06b3-4073-bd77-06a2324cfd70]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:06 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc 1073741824" returned: 0 in 0.520s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:06 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 Apr 08 15:52:06 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:06 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc Apr 08 15:52:06 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475" returned: 0 in 0.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec" returned: 0 in 0.709s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475 Apr 08 15:52:07 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec Apr 08 15:52:07 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc" returned: 0 in 0.555s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.200s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bec65d1-8920-4a31-94b1-bd81cafff838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39f183c-fb37-46fb-819b-d70ac4daffdc', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063d3eb4-541e-4664-8d45-50492598838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Creating offline snapshot 6b546d63-f523-480a-b6ac-bd126eca4cce of volume abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:52:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Volume volume-e39f183c-fb37-46fb-819b-d70ac4daffdc (e39f183c-fb37-46fb-819b-d70ac4daffdc): created successfully Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063d3eb4-541e-4664-8d45-50492598838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Flow 'volume_create_manager' (5cd40d0f-564a-4650-a933-8339bf7addb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef58d83-8026-4660-bb7b-a1d695e94f65]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e7423716-3686-430b-9bde-c5814ae35205 tempest-SnapshotMetadataTestJSON-393172175 None] Created volume successfully. Apr 08 15:52:07 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:07 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:07 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6b83d116-f1b5-4b7e-9097-80fdce318475" returned: 0 in 0.497s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-6b83d116-f1b5-4b7e-9097-80fdce318475" released by "delete_volume" :: held 1.112s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Created reservations ['4334f07d-dd0d-41f3-b02e-6f21d25d172e', 'da5c2ad3-9945-4ed5-8686-f336a631454c', '69c2178e-ad5a-4b54-8200-fa242ac17421', '1608d894-f158-473d-a825-e34746b4274a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:07 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-45b05a07-c475-48bc-a956-7f266916b2ec" returned: 0 in 0.578s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "cinder-quobyte-45b05a07-c475-48bc-a956-7f266916b2ec" released by "delete_volume" :: held 1.339s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:07 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:07 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:07 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.507s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce 1G Apr 08 15:52:07 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Created reservations ['7d8dd492-a8ca-458c-a326-3772065c628d', '0627c621-5622-474b-bd2a-1d548a31a88c', 'e756cefe-c508-46c5-bc5b-463634446e70', 'c325be8d-55e9-42e0-aa05-df73636eb8d1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:07 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:07 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:08 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.407s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Deleted volume successfully. Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-805cbeac-43ff-4c13-9b52-3a8ee1ddf528 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-6b83d116-f1b5-4b7e-9097-80fdce318475-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:08 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.498s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Deleted volume successfully. Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a6e2d51c-2607-49fe-911e-bf578c990e96 tempest-VolumesListAdminTestJSON-1117150041 None] Lock "cinder-45b05a07-c475-48bc-a956-7f266916b2ec-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:08 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce 1G" returned: 0 in 0.640s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf95f5d-97e3-470b-a699-cf61bbece270 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:08 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf95f5d-97e3-470b-a699-cf61bbece270 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:08 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-5edbe6b6-314c-4618-96c2-25d544d9d0c9-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-5edbe6b6-314c-4618-96c2-25d544d9d0c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-quobyte-5edbe6b6-314c-4618-96c2-25d544d9d0c9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-5edbe6b6-314c-4618-96c2-25d544d9d0c9" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5a5ff-8ae9-4d99-8e97-2596edd00ce6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:08 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 Apr 08 15:52:08 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:08 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf95f5d-97e3-470b-a699-cf61bbece270 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.582s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:09 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce is being set with open permissions: ugo+rw Apr 08 15:52:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:09 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:09 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:09 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9" returned: 0 in 0.708s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:09 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9 Apr 08 15:52:09 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:09 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.674s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:09 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info Apr 08 15:52:09 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:10 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5edbe6b6-314c-4618-96c2-25d544d9d0c9" returned: 0 in 0.565s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-5edbe6b6-314c-4618-96c2-25d544d9d0c9" released by "delete_volume" :: held 1.303s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Created reservations ['3161f3b9-68b9-4a2d-9eec-cf67848b7f85', '48422bdb-e49b-42c9-bef2-bd980659d828', '7088160f-9f58-4601-9991-47ce501f0682', '4c7cfaf7-059e-4a81-88bb-0e86673e8af2'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:10 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:10 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info is being set with open permissions: ugo+rw Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:10 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info Apr 08 15:52:10 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:10 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:10 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:10 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.info" returned: 0 in 0.421s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.393s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.084s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:10 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4f26e1b1-4fa1-4967-8a9e-a6b17e9fb8aa tempest-VolumesDeleteCascade-1824486233 None] Create snapshot completed successfully Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Creating offline snapshot 0704d0df-cac4-412e-bab5-f0a5433f7011 of volume e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a2b60-3ce3-490f-8be8-3bf4dba9d36e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Deleted volume successfully. Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b144242-ce33-48f3-94ca-a132d8275345 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-5edbe6b6-314c-4618-96c2-25d544d9d0c9-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:10 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc Apr 08 15:52:10 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-e602172d-911a-4b31-bad5-7a9dfa1650fe-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-e602172d-911a-4b31-bad5-7a9dfa1650fe-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "cinder-quobyte-e602172d-911a-4b31-bad5-7a9dfa1650fe" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-e602172d-911a-4b31-bad5-7a9dfa1650fe" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced18f6-4510-4701-a358-7019ed08a310]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:11 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe Apr 08 15:52:11 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:11 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc" returned: 0 in 0.626s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:11 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 1G Apr 08 15:52:11 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (2fea39db-abd9-4e06-a778-b93ba95e4660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03630311-0063-473f-b8d5-e3b494280778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03630311-0063-473f-b8d5-e3b494280778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-357666224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e42e32-773d-4fa0-9645-344bf4e24c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bdf233e75e418285174d5d904fd863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b546d63-f523-480a-b6ac-bd126eca4cce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:12Z,use_quota=True,user_id='e6fd4e447c0a466fbd7dd9aec60828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc2fd5-b5f4-4832-988e-61a87a378b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc2fd5-b5f4-4832-988e-61a87a378b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd29d74-7570-4515-ab2a-30812f6b16ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd29d74-7570-4515-ab2a-30812f6b16ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86e42e32-773d-4fa0-9645-344bf4e24c19', 'volume_name': 'volume-86e42e32-773d-4fa0-9645-344bf4e24c19', 'volume_size': 1, 'snapshot_id': '6b546d63-f523-480a-b6ac-bd126eca4cce'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36233c53-c471-455c-817e-a75f4914fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36233c53-c471-455c-817e-a75f4914fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a418995-fb08-4efc-a829-0f6e253a9613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:11 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Volume 86e42e32-773d-4fa0-9645-344bf4e24c19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86e42e32-773d-4fa0-9645-344bf4e24c19', 'volume_size': 1, 'snapshot_id': '6b546d63-f523-480a-b6ac-bd126eca4cce'} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:11 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe" returned: 0 in 0.644s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:11 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe Apr 08 15:52:11 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:11 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 1G" returned: 0 in 0.625s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39f183c-fb37-46fb-819b-d70ac4daffdc -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:11 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39f183c-fb37-46fb-819b-d70ac4daffdc -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 Apr 08 15:52:11 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:12 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e602172d-911a-4b31-bad5-7a9dfa1650fe" returned: 0 in 0.432s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-quobyte-e602172d-911a-4b31-bad5-7a9dfa1650fe" released by "delete_volume" :: held 1.130s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Created reservations ['51b9b87e-6c4d-43de-b618-343d88306785', 'a8ee6707-a2c5-4063-8c4c-8c036cbf56c2', 'f077fd3b-ac8a-4a08-bdd1-0456a9575411', 'd66897da-a46f-4d06-9d1b-a17abe758146'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:12 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:12 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:12 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39f183c-fb37-46fb-819b-d70ac4daffdc -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011" returned: 0 in 0.615s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:12 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 is being set with open permissions: ugo+rw Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:12 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 Apr 08 15:52:12 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:12 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.496s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Deleted volume successfully. Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1ef4478-679d-4a29-b5bc-e8a686f09e53 tempest-VolumesListAdminTestJSON-226340017 None] Lock "cinder-e602172d-911a-4b31-bad5-7a9dfa1650fe-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:12 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011" returned: 0 in 0.433s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:13 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info Apr 08 15:52:13 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:13 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info" returned: 0 in 0.482s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:13 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info is being set with open permissions: ugo+rw Apr 08 15:52:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:13 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info Apr 08 15:52:13 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:14 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.info" returned: 0 in 0.587s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.383s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce-86e42e32-773d-4fa0-9645-344bf4e24c19" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2d7ff1e8-582d-4c7a-9cc8-6694272e17c4 tempest-SnapshotMetadataTestJSON-393172175 None] Create snapshot completed successfully Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce-86e42e32-773d-4fa0-9645-344bf4e24c19" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Creating volume 86e42e32-773d-4fa0-9645-344bf4e24c19 from snapshot 6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] snapshot: 6b546d63-f523-480a-b6ac-bd126eca4cce, volume: 86e42e32-773d-4fa0-9645-344bf4e24c19, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe655c9-4b51-4609-9a45-30aeb1c55b01]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:14 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:14 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:15 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.920s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abf95f5d-97e3-470b-a699-cf61bbece270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d08cc-2568-43b9-b229-c93ea9719fc9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:15 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:15 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "cinder-0704d0df-cac4-412e-bab5-f0a5433f7011-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-0704d0df-cac4-412e-bab5-f0a5433f7011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "cinder-quobyte-0704d0df-cac4-412e-bab5-f0a5433f7011" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-0704d0df-cac4-412e-bab5-f0a5433f7011" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Deleting offline snapshot 0704d0df-cac4-412e-bab5-f0a5433f7011 of volume e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] snapshot_file for this snap is: volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46081b-652c-4e98-bc6b-5034407adce0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:16 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 Apr 08 15:52:16 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:16 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.956s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:16 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 Apr 08 15:52:16 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:16 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011" returned: 0 in 0.625s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39f183c-fb37-46fb-819b-d70ac4daffdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ad75a4-2e62-4df0-be45-3d99ffda54c0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:16 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc Apr 08 15:52:16 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:18 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc" returned: 0 in 1.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:18 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 Apr 08 15:52:18 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:18 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19" returned: 0 in 2.794s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c170b5-6d6c-43ba-9115-be97a12c89a3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:18 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:18 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:19 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011" returned: 0 in 0.907s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:19 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011 Apr 08 15:52:19 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:19 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc.0704d0df-cac4-412e-bab5-f0a5433f7011" returned: 0 in 0.478s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:19 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.697s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-0704d0df-cac4-412e-bab5-f0a5433f7011" released by "_delete_snapshot" :: held 3.730s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:52:19 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Converted 1024.00 MB image at 366.28 MB/s Apr 08 15:52:19 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 is being set with open permissions: ugo+rw Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" released by "delete_snapshot" :: held 3.772s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:19 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 Apr 08 15:52:19 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Flow 'volume_create_manager' (47f21317-e77c-40af-b318-4c2e97c86b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4064342e-3996-4568-a3b8-dad2e5e2ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4064342e-3996-4568-a3b8-dad2e5e2ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1328368682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c027c9c-ccf7-47f2-b6c7-75b76461a59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636234c7a8994cbe98bba1be289b5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:20Z,use_quota=True,user_id='c31685e1ddb2494ea0209cba6195c3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb059e93-893e-4326-9000-77ca8ab5807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb059e93-893e-4326-9000-77ca8ab5807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e82937-1300-48fc-9455-8e7e1a4fc77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e82937-1300-48fc-9455-8e7e1a4fc77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c027c9c-ccf7-47f2-b6c7-75b76461a59d', 'volume_name': 'volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f770fc-6b2b-425c-9a25-86c5c78855f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f770fc-6b2b-425c-9a25-86c5c78855f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b1b331-aa10-4b40-962b-2e610fcb1258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:19 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Volume 6c027c9c-ccf7-47f2-b6c7-75b76461a59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d', 'volume_size': 1} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Created reservations ['01a58e36-18d3-4dfb-a793-7e55ad56e226', 'bf44156f-f89c-41c7-b538-0675c4ab279e', '73074155-0791-4f20-8fe9-12d29d120a9a', 'e6f335dd-a25a-49a9-9c7d-49975abb5169'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Delete snapshot completed successfully. Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a91671fa-885d-4ed8-af45-8bf90fedda63 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-0704d0df-cac4-412e-bab5-f0a5433f7011-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-eaea68ba-6986-4b29-a635-6ed3dc7b3ef9 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Terminate volume connection completed successfully. Apr 08 15:52:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-eaea68ba-6986-4b29-a635-6ed3dc7b3ef9 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Deleting attachment 7d9b223c-7f55-4400-9eb9-e65bb64cfa22. {{(pid=82216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 15:52:20 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" released by "_copy_volume_from_snapshot" :: held 5.932s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce-86e42e32-773d-4fa0-9645-344bf4e24c19" released by "_create_volume_from_snapshot" :: held 5.969s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1328368682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c027c9c-ccf7-47f2-b6c7-75b76461a59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636234c7a8994cbe98bba1be289b5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:20Z,use_quota=True,user_id='c31685e1ddb2494ea0209cba6195c3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Creating volume 6c027c9c-ccf7-47f2-b6c7-75b76461a59d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:20 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d 1073741824 Apr 08 15:52:20 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a418995-fb08-4efc-a829-0f6e253a9613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e42e32-773d-4fa0-9645-344bf4e24c19', 'volume_size': 1, 'snapshot_id': '6b546d63-f523-480a-b6ac-bd126eca4cce'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47113664-49e5-4bb0-80b6-f85f3f3cd3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Volume volume-86e42e32-773d-4fa0-9645-344bf4e24c19 (86e42e32-773d-4fa0-9645-344bf4e24c19): created successfully Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47113664-49e5-4bb0-80b6-f85f3f3cd3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Flow 'volume_create_manager' (2fea39db-abd9-4e06-a778-b93ba95e4660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bfd7a2b0-8abd-4484-b781-af5149e8913f tempest-VolumesDeleteCascade-1824486233 None] Created volume successfully. Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "cinder-e39f183c-fb37-46fb-819b-d70ac4daffdc-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-e39f183c-fb37-46fb-819b-d70ac4daffdc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0212d-eafb-4462-95d7-9d465a091521]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc Apr 08 15:52:20 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-abf95f5d-97e3-470b-a699-cf61bbece270-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-abf95f5d-97e3-470b-a699-cf61bbece270-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Performing cascade delete. {{(pid=82216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-6b546d63-f523-480a-b6ac-bd126eca4cce-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-6b546d63-f523-480a-b6ac-bd126eca4cce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Deleting offline snapshot 6b546d63-f523-480a-b6ac-bd126eca4cce of volume abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] snapshot_file for this snap is: volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a349331-04ea-44b8-8144-79786f7c646c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "cinder-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:20 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "cinder-quobyte-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-quobyte-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:20 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d 1073741824" returned: 0 in 0.578s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba41f91-e485-4525-b4a7-59391173dc07]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d Apr 08 15:52:20 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:20 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:52:20 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:20 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc" returned: 0 in 0.628s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:20 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc Apr 08 15:52:20 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.614s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abf95f5d-97e3-470b-a699-cf61bbece270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[786528f7-36dc-481c-adad-d3332c4dc4c0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" returned: 0 in 0.448s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b1b331-aa10-4b40-962b-2e610fcb1258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b63794a-71b2-4eaa-af35-9107f5261d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Volume volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d (6c027c9c-ccf7-47f2-b6c7-75b76461a59d): created successfully Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b63794a-71b2-4eaa-af35-9107f5261d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Flow 'volume_create_manager' (47f21317-e77c-40af-b318-4c2e97c86b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-78a73042-471a-4476-bb71-cdf89ba7efd8 tempest-VolumesTransfersV357Test-758982903 None] Created volume successfully. Apr 08 15:52:21 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:21 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 0.571s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:52:21 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e39f183c-fb37-46fb-819b-d70ac4daffdc" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-quobyte-e39f183c-fb37-46fb-819b-d70ac4daffdc" released by "delete_volume" :: held 1.223s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Created reservations ['3d0a0f48-9a3a-4fa1-a67a-39651b1611d3', '5763e08f-8ceb-49a3-829c-6d0b2478b688', '26fa2f48-3241-45e0-8f23-bbb99fe2ee4c', '8878cce4-a5ed-414b-90e0-ff5088c93743'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:21 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:21 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.514s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:21 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:21 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 1 in 0.569s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:52:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:21 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a Apr 08 15:52:21 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:22 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.535s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:22 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.631s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Deleted volume successfully. Apr 08 15:52:22 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-acbf247d-3a6e-4f47-b25b-39ba4d7015e8 tempest-SnapshotMetadataTestJSON-393172175 None] Lock "cinder-e39f183c-fb37-46fb-819b-d70ac4daffdc-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:22 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce Apr 08 15:52:22 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:22 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-quobyte-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a" released by "delete_volume" :: held 1.662s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.quota [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Created reservations ['754162b6-4091-43da-ae1e-4e4703f44cf9', '74a03bbe-7e8a-4e8b-a9ec-22a7d6c54966', 'e0de944f-578a-473d-aa8e-29b101e0085b', 'e244f5f8-3c23-4cdb-8e6c-9a658a90a751'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9ea3e9b1-daa1-4bff-99b1-dd3a215d0f6c tempest-VolumesTransfersV357Test-2012394777 None] Transfer volume completed successfully. Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:22 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:22 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:22 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270.6b546d63-f523-480a-b6ac-bd126eca4cce" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-6b546d63-f523-480a-b6ac-bd126eca4cce" released by "_delete_snapshot" :: held 2.257s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" released by "delete_snapshot" :: held 2.273s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['bbb0260c-7d37-4afe-a53c-18758711260c', '9d036d1e-fda6-48e4-b45c-8ba7c2352255', 'ee29ea71-712f-4fa5-8436-f34a95cfecf9', '505e9b63-34dc-4247-b70f-1665684b0c39'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Delete snapshot completed successfully. Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-6b546d63-f523-480a-b6ac-bd126eca4cce-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Snapshots deleted, issuing volume delete {{(pid=82216) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b42277-a92d-4c25-918e-79b7f16c6f3a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:22 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.manager [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Deleted volume successfully. Apr 08 15:52:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-e0b330d7-41c5-4151-9c2f-2748278963c5 req-23d089bc-ef13-4489-80f4-f894edf39395 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-896f3cc9-f0d4-40f3-9a10-ba0f9e29ec0a-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:23 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:23 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:23 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.606s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:23 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270 Apr 08 15:52:23 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "cinder-6c027c9c-ccf7-47f2-b6c7-75b76461a59d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-6c027c9c-ccf7-47f2-b6c7-75b76461a59d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "cinder-quobyte-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-quobyte-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63317c75-8ed6-4066-8443-ae91a191469e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:23 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d Apr 08 15:52:23 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:23 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-abf95f5d-97e3-470b-a699-cf61bbece270" returned: 0 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-abf95f5d-97e3-470b-a699-cf61bbece270" released by "delete_volume" :: held 1.120s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['ba58dacf-191b-418e-9f9b-cba6f6cd170b', '7c531c38-f461-4e54-9d05-616ed0dec159', '6f14705d-2a65-4d6f-a95c-8e319f888b9e', '76ceebaa-06ce-4fce-ac47-391e1002056e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:24 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:24 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:24 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" returned: 0 in 0.680s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:24 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d Apr 08 15:52:24 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:24 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.550s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Deleted volume successfully. Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-99f02670-c51f-4d9e-b96d-6f7994afc334 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-abf95f5d-97e3-470b-a699-cf61bbece270-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:24 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" returned: 0 in 0.486s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-quobyte-6c027c9c-ccf7-47f2-b6c7-75b76461a59d" released by "delete_volume" :: held 1.191s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Created reservations ['c1403dac-63a1-4c33-8185-4912e01c54f2', '02f1bfc8-e2cb-479e-b241-50504e1e83ac', '90afae83-eacf-4a8d-b7cb-bd4bc837c40c', '476b59fe-e6f6-43e1-a187-253bd7c6b5d8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-86e42e32-773d-4fa0-9645-344bf4e24c19-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-86e42e32-773d-4fa0-9645-344bf4e24c19-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:24 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:24 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361e028-adee-431c-a4b3-b5d13bf673c4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:25 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 Apr 08 15:52:25 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Flow 'volume_create_manager' (458ef356-4cf6-45ef-81db-e0d18c841348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc1f83c-8fcb-4ab1-a44a-841b0bda2b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc1f83c-8fcb-4ab1-a44a-841b0bda2b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1695436290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289d4f19bc2546f594cfc4605b24c32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:25Z,use_quota=True,user_id='299c4ab89e644c3aa4135bc83ef86637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da541fa6-e08c-4089-9611-b0c750171f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da541fa6-e08c-4089-9611-b0c750171f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe04be-441b-4ce6-afb5-dd7b9ad900b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe04be-441b-4ce6-afb5-dd7b9ad900b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd', 'volume_name': 'volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944c8dd3-3347-4514-a90f-8f0fca9785cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944c8dd3-3347-4514-a90f-8f0fca9785cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da46fcd-1066-485f-a53e-18fe92f5b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Volume fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd', 'volume_size': 1} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1695436290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289d4f19bc2546f594cfc4605b24c32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:25Z,use_quota=True,user_id='299c4ab89e644c3aa4135bc83ef86637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Creating volume fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:25 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:25 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd 1073741824 Apr 08 15:52:25 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:25 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.549s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Deleted volume successfully. Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fe49162b-a791-48b3-abd7-b9d1fdda10c2 tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-6c027c9c-ccf7-47f2-b6c7-75b76461a59d-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:25 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19" returned: 0 in 0.629s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:25 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19 Apr 08 15:52:25 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:26 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Flow 'volume_create_manager' (7e3a1909-8cef-41b6-a9c3-a777f57cbbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17f6e05-e794-48b6-9a57-7e2bfebe002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17f6e05-e794-48b6-9a57-7e2bfebe002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1673893153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa30a4-3e81-4dcb-be9b-47d078da1382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636234c7a8994cbe98bba1be289b5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:26Z,use_quota=True,user_id='c31685e1ddb2494ea0209cba6195c3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97425341-4f87-439c-9f65-d7286193d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97425341-4f87-439c-9f65-d7286193d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca24a8c5-d87f-4865-bc57-2ca522913c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca24a8c5-d87f-4865-bc57-2ca522913c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfa30a4-3e81-4dcb-be9b-47d078da1382', 'volume_name': 'volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987f1c38-95d8-420c-9a24-81e98f70fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987f1c38-95d8-420c-9a24-81e98f70fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399607b9-9c7a-4ea2-9d8c-33c99b5ef2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Volume bcfa30a4-3e81-4dcb-be9b-47d078da1382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382', 'volume_size': 1} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd 1073741824" returned: 0 in 0.819s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:26 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd Apr 08 15:52:26 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:26 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86e42e32-773d-4fa0-9645-344bf4e24c19" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-quobyte-86e42e32-773d-4fa0-9645-344bf4e24c19" released by "delete_volume" :: held 1.220s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Created reservations ['e334454d-e2e4-48e3-a201-79e38a684f13', 'b18f111f-75c2-43bf-ad86-abb4834065c5', 'cd71672c-2a19-4f11-9b3e-1321f2b1f652', '37db1d62-5777-4c0e-8f2b-72cd78db06c8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:26 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:26 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:26 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" returned: 0 in 0.524s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1673893153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfa30a4-3e81-4dcb-be9b-47d078da1382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636234c7a8994cbe98bba1be289b5e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:26Z,use_quota=True,user_id='c31685e1ddb2494ea0209cba6195c3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Creating volume bcfa30a4-3e81-4dcb-be9b-47d078da1382 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:26 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:26 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 1073741824 Apr 08 15:52:26 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da46fcd-1066-485f-a53e-18fe92f5b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d03f86a-c6b9-4b1d-94b5-75ffc7200007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Deleted volume successfully. Apr 08 15:52:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Volume volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd (fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd): created successfully Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d03f86a-c6b9-4b1d-94b5-75ffc7200007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Flow 'volume_create_manager' (458ef356-4cf6-45ef-81db-e0d18c841348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-599eadb0-e84d-4000-9f80-8013a178ada0 tempest-VolumesDeleteCascade-1824486233 None] Lock "cinder-86e42e32-773d-4fa0-9645-344bf4e24c19-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ac25bf76-2dd4-48f0-8bf3-3f82425b8821 tempest-AbsoluteLimitsTests-681559952 None] Created volume successfully. Apr 08 15:52:27 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 1073741824" returned: 0 in 0.562s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:27 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 Apr 08 15:52:27 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Acquiring lock "cinder-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "cinder-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Acquiring lock "cinder-quobyte-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "cinder-quobyte-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c133906f-49a3-4320-8e3c-f5b28b3c3d88]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:27 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd Apr 08 15:52:27 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:27 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399607b9-9c7a-4ea2-9d8c-33c99b5ef2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca64417-769d-46e7-8ef3-4fd850cd79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Volume volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 (bcfa30a4-3e81-4dcb-be9b-47d078da1382): created successfully Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca64417-769d-46e7-8ef3-4fd850cd79dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Flow 'volume_create_manager' (7e3a1909-8cef-41b6-a9c3-a777f57cbbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f52970f5-08d6-460f-bb42-536f96d03e34 tempest-VolumesTransfersV357Test-758982903 None] Created volume successfully. Apr 08 15:52:28 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" returned: 0 in 0.555s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:28 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd Apr 08 15:52:28 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "cinder-bcfa30a4-3e81-4dcb-be9b-47d078da1382-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-bcfa30a4-3e81-4dcb-be9b-47d078da1382-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "cinder-quobyte-bcfa30a4-3e81-4dcb-be9b-47d078da1382" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-quobyte-bcfa30a4-3e81-4dcb-be9b-47d078da1382" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7915c9-4737-4d79-afe8-794c9d21b4bf]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:28 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" returned: 0 in 0.571s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "cinder-quobyte-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd" released by "delete_volume" :: held 1.165s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:28 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 Apr 08 15:52:28 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Created reservations ['ab46977b-2f3b-48fe-a64f-fcefc3c0fd4c', '6868fb7e-99a9-467d-96a7-0316a8f04351', '1c3b93a6-d153-4521-af19-3b4548f8cacb', 'd123171c-8198-4b75-abfc-86ab8bf610b2'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:28 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:28 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:29 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382" returned: 0 in 0.561s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:29 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382 Apr 08 15:52:29 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:29 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Deleted volume successfully. Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-45c21d59-0a19-4d99-896d-1fda2235a44a tempest-AbsoluteLimitsTests-681559952 None] Lock "cinder-fdaeb2bf-8c3b-4f93-8973-4adeef9b96dd-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:29 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcfa30a4-3e81-4dcb-be9b-47d078da1382" returned: 0 in 0.483s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-quobyte-bcfa30a4-3e81-4dcb-be9b-47d078da1382" released by "delete_volume" :: held 1.085s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Created reservations ['cee4f181-07f9-4b97-a912-ad4b89f73643', 'cc066863-2b7b-4f62-a7e3-60c4b0f151db', '4acae7af-cfde-4af0-901f-97ab41f01480', 'e78cbca1-7282-4057-853e-794d9c09fd80'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:29 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:29 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:30 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.548s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:30 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Deleted volume successfully. Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ea67730b-3a56-4292-95ef-e2d7c710769c tempest-VolumesTransfersV357Test-1496208884 None] Lock "cinder-bcfa30a4-3e81-4dcb-be9b-47d078da1382-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Flow 'volume_create_manager' (7c8bd682-edb8-4ba0-b4ee-6d86c373e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bee153-f05f-49bf-a763-b039fdfbc274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bee153-f05f-49bf-a763-b039fdfbc274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-124163278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76bde4b0e594c2981e55b4c77596185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:30Z,use_quota=True,user_id='7ecdca17434a42c6ae1412a68e16734b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d28a47a-f6c4-4568-99aa-fe0caf8422aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d28a47a-f6c4-4568-99aa-fe0caf8422aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f210f8-a75c-47ea-9727-932248d0dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f210f8-a75c-47ea-9727-932248d0dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99', 'volume_name': 'volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66725573-8ab1-4302-bda9-7e2aa12fad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66725573-8ab1-4302-bda9-7e2aa12fad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417d20e4-fdbb-426e-9c18-ba5d56373f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Volume 1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99', 'volume_size': 1} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-124163278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76bde4b0e594c2981e55b4c77596185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:30Z,use_quota=True,user_id='7ecdca17434a42c6ae1412a68e16734b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Creating volume 1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:30 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:30 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 1073741824 Apr 08 15:52:30 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:31 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 1073741824" returned: 0 in 0.670s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:31 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 Apr 08 15:52:31 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:31 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" returned: 0 in 0.492s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417d20e4-fdbb-426e-9c18-ba5d56373f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b035e8-8e21-4940-a052-2ebff4b94266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Volume volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 (1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99): created successfully Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b035e8-8e21-4940-a052-2ebff4b94266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Flow 'volume_create_manager' (7c8bd682-edb8-4ba0-b4ee-6d86c373e351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2117baed-a5ed-4e6d-b26a-391d254dda8d tempest-VolumesTransfersV355Test-1496958426 None] Created volume successfully. Apr 08 15:52:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-66084ac9-402d-4ea2-a5f3-66630bf33207 tempest-VolumesTransfersV355Test-1777840008 None] Transfer volume completed successfully. Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Flow 'volume_create_manager' (39a9a787-ca3a-4ef6-bc4f-ab999729419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9364aaa6-d227-4604-8221-d170c9d2da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9364aaa6-d227-4604-8221-d170c9d2da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2018439166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa859f63-9564-4292-985a-61af7fc32988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f82b191c7246538b28e3d17d33da5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:33Z,use_quota=True,user_id='5ac13f4f44844dab902693a490083333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54264dd-5a7f-4c80-a676-a8d99b37fddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54264dd-5a7f-4c80-a676-a8d99b37fddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004b7415-5c3e-4881-8c05-ab480e5b4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004b7415-5c3e-4881-8c05-ab480e5b4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa859f63-9564-4292-985a-61af7fc32988', 'volume_name': 'volume-aa859f63-9564-4292-985a-61af7fc32988', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4296ded3-975f-4d23-bf82-dfc3536cb2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4296ded3-975f-4d23-bf82-dfc3536cb2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16dacdea-6838-408c-8acc-a9b5e7a931eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:33 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Volume aa859f63-9564-4292-985a-61af7fc32988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa859f63-9564-4292-985a-61af7fc32988', 'volume_size': 1} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2018439166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa859f63-9564-4292-985a-61af7fc32988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f82b191c7246538b28e3d17d33da5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:33Z,use_quota=True,user_id='5ac13f4f44844dab902693a490083333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Creating volume aa859f63-9564-4292-985a-61af7fc32988 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:33 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:33 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 1073741824 Apr 08 15:52:33 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-0cc36af9-d38d-484e-85e4-8f3056447131 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Terminate volume connection completed successfully. Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-0cc36af9-d38d-484e-85e4-8f3056447131 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Deleting attachment be6c239d-01a7-417a-baf6-5334329b1267. {{(pid=82216) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 15:52:34 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 1073741824" returned: 0 in 0.696s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:34 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 Apr 08 15:52:34 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "cinder-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "cinder-quobyte-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-quobyte-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949e959-1fec-4ebc-9ac3-f7f03d4e38ac]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:34 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 Apr 08 15:52:34 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "cinder-4c2a0cfa-6834-4215-aeea-c0f22784807f-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-4c2a0cfa-6834-4215-aeea-c0f22784807f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "cinder-quobyte-4c2a0cfa-6834-4215-aeea-c0f22784807f" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-quobyte-4c2a0cfa-6834-4215-aeea-c0f22784807f" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07261f-ba9b-4947-bca5-96874785eddd]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:34 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988" returned: 0 in 0.670s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16dacdea-6838-408c-8acc-a9b5e7a931eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa859f63-9564-4292-985a-61af7fc32988', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedcf265-c40e-4568-99e5-a4554aba0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:34 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Volume volume-aa859f63-9564-4292-985a-61af7fc32988 (aa859f63-9564-4292-985a-61af7fc32988): created successfully Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedcf265-c40e-4568-99e5-a4554aba0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Flow 'volume_create_manager' (39a9a787-ca3a-4ef6-bc4f-ab999729419c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d1d11240-1efd-4d6a-a8f8-0d910f329255 tempest-VolumesMetadataTest-1762762575 None] Created volume successfully. Apr 08 15:52:34 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f Apr 08 15:52:34 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:35 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" returned: 0 in 0.637s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:35 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99 Apr 08 15:52:35 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:35 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f" returned: 0 in 0.624s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:35 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f Apr 08 15:52:35 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:35 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" returned: 0 in 0.545s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-quobyte-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99" released by "delete_volume" :: held 1.215s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Created reservations ['d85907ef-1551-434b-950b-1de14bb421d1', 'f8afd1fa-fe79-4a47-bdb7-6638265927e7', '8942dc1b-9fb2-4a20-94ff-ceb0d2086231', '96253b8a-caa3-4020-8d78-a78494ffe6d0'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:35 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:35 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:35 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4c2a0cfa-6834-4215-aeea-c0f22784807f" returned: 0 in 0.609s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-quobyte-4c2a0cfa-6834-4215-aeea-c0f22784807f" released by "delete_volume" :: held 1.271s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.quota [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Created reservations ['f3797796-6fe0-4199-873b-3549315a0d3c', '1d38aa72-9bd9-4877-b7a7-1046ff97961f', 'e30d3c15-9e88-4e29-bce2-570f63cc844a', 'a7b2847f-ddb7-427e-a9cc-810650abbdb1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:36 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:36 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Acquiring lock "cinder-aa859f63-9564-4292-985a-61af7fc32988-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "cinder-aa859f63-9564-4292-985a-61af7fc32988-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Acquiring lock "cinder-quobyte-aa859f63-9564-4292-985a-61af7fc32988" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "cinder-quobyte-aa859f63-9564-4292-985a-61af7fc32988" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36650ab5-a34b-48c1-97cf-ae4edacdae7d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:36 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.624s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Deleted volume successfully. Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-26e126da-705d-4996-baa3-8c5fb920d831 tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-1fcfc78e-f007-4e9f-9c8f-1aa2f9b97f99-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:36 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 Apr 08 15:52:36 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:36 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.574s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.manager [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Deleted volume successfully. Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [req-89d4bcf6-100d-4d54-9c07-680dc3b7f034 req-7e7d2e29-1bad-4760-b29a-cd5b12ebbe70 tempest-ServerBootFromVolumeStableRescueTest-1279582190 None] Lock "cinder-4c2a0cfa-6834-4215-aeea-c0f22784807f-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:36 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Flow 'volume_create_manager' (dc2a8bb1-5564-4afa-934a-7c155a7571c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05237404-b04d-4a15-ba71-0a999a9cf247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:37 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05237404-b04d-4a15-ba71-0a999a9cf247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1536733026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d71588-5ab1-4502-a51b-ae1416c78a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76bde4b0e594c2981e55b4c77596185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:37Z,use_quota=True,user_id='7ecdca17434a42c6ae1412a68e16734b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7c2e6-e358-48c1-a3aa-6245937c7186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7c2e6-e358-48c1-a3aa-6245937c7186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645bddc-e51e-4913-892d-8a48fb264aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645bddc-e51e-4913-892d-8a48fb264aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d71588-5ab1-4502-a51b-ae1416c78a7e', 'volume_name': 'volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad653009-6b94-41a8-a5b0-134c4603df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad653009-6b94-41a8-a5b0-134c4603df68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355f73af-ddcb-402f-afbf-37cdc6f48bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:37 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Volume e4d71588-5ab1-4502-a51b-ae1416c78a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e', 'volume_size': 1} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1536733026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d71588-5ab1-4502-a51b-ae1416c78a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76bde4b0e594c2981e55b4c77596185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:37Z,use_quota=True,user_id='7ecdca17434a42c6ae1412a68e16734b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Creating volume e4d71588-5ab1-4502-a51b-ae1416c78a7e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:37 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988" returned: 0 in 0.723s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:37 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e 1073741824 Apr 08 15:52:37 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:37 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988 Apr 08 15:52:37 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:37 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-aa859f63-9564-4292-985a-61af7fc32988" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "cinder-quobyte-aa859f63-9564-4292-985a-61af7fc32988" released by "delete_volume" :: held 1.265s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Created reservations ['1eda5a4d-8976-44a5-aec8-0b5f80051006', '7899e10d-cc2a-44a2-b1c1-37f38d767fdf', '02c32618-20f1-4cf1-8002-0b8c2785aa31', 'b63770fe-2936-46c8-a24d-2a78a519f282'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:37 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:37 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:37 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e 1073741824" returned: 0 in 0.627s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:37 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e Apr 08 15:52:37 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:38 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:38 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Deleted volume successfully. Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2c9850b-8975-4ccc-a57d-a500d2b0c889 tempest-VolumesMetadataTest-1762762575 None] Lock "cinder-aa859f63-9564-4292-985a-61af7fc32988-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:38 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e" returned: 0 in 0.560s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355f73af-ddcb-402f-afbf-37cdc6f48bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b93b1-3607-42e7-99ca-ee6533dc3753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:38 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Volume volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e (e4d71588-5ab1-4502-a51b-ae1416c78a7e): created successfully Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b93b1-3607-42e7-99ca-ee6533dc3753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Flow 'volume_create_manager' (dc2a8bb1-5564-4afa-934a-7c155a7571c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:38 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8537f2b3-9ced-4860-be5f-a8c7c7c7a3a4 tempest-VolumesTransfersV355Test-1496958426 None] Created volume successfully. Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "cinder-e4d71588-5ab1-4502-a51b-ae1416c78a7e-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-e4d71588-5ab1-4502-a51b-ae1416c78a7e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "cinder-quobyte-e4d71588-5ab1-4502-a51b-ae1416c78a7e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-quobyte-e4d71588-5ab1-4502-a51b-ae1416c78a7e" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ac9d7-ac46-46dd-a712-33829c3c3894]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:39 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e Apr 08 15:52:39 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:40 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e" returned: 0 in 0.687s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:40 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e Apr 08 15:52:40 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Flow 'volume_create_manager' (1fd72b6e-63fc-4cf6-bc00-4c731b91d49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaa2afc-0364-483b-9439-efc6f995efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaa2afc-0364-483b-9439-efc6f995efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1372469702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57605c34-d288-42b3-abb3-e6db0f4b91f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dffa00bb4b44eb81e71e5cebfc7ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:40Z,use_quota=True,user_id='cccebf42151f4fc490237cd09c8ad1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5e84c-09da-4e6f-9769-60a54a6588ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5e84c-09da-4e6f-9769-60a54a6588ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a587426-b8d9-4c6a-96d7-0b24f0984421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a587426-b8d9-4c6a-96d7-0b24f0984421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57605c34-d288-42b3-abb3-e6db0f4b91f6', 'volume_name': 'volume-57605c34-d288-42b3-abb3-e6db0f4b91f6', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d27fc-aefa-4de4-b4cc-f989f5820d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d27fc-aefa-4de4-b4cc-f989f5820d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c6ddad-70bc-418d-8530-7fee4303bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:40 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Volume 57605c34-d288-42b3-abb3-e6db0f4b91f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57605c34-d288-42b3-abb3-e6db0f4b91f6', 'volume_size': 1} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1372469702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57605c34-d288-42b3-abb3-e6db0f4b91f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dffa00bb4b44eb81e71e5cebfc7ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:40Z,use_quota=True,user_id='cccebf42151f4fc490237cd09c8ad1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Creating volume 57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:40 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:40 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 1073741824 Apr 08 15:52:40 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:40 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e4d71588-5ab1-4502-a51b-ae1416c78a7e" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-quobyte-e4d71588-5ab1-4502-a51b-ae1416c78a7e" released by "delete_volume" :: held 1.202s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Created reservations ['e67bccb3-5a3e-43ba-8ee8-d67332efa3bb', '4bfc4eff-9dad-4dcf-8a8a-6bc37a330f7d', '63918cc8-54f2-4578-b780-79795ec95a8c', 'ff9a8c57-f00e-4038-98f5-6b3d434753b3'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:40 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:40 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:41 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 1073741824" returned: 0 in 0.581s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:41 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:41 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:41 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.622s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Deleted volume successfully. Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-52ac1e1e-f7d3-49c2-9b52-cb7ee8b37aeb tempest-VolumesTransfersV355Test-156704144 None] Lock "cinder-e4d71588-5ab1-4502-a51b-ae1416c78a7e-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Flow 'volume_create_manager' (8b571d55-43b3-4150-aad2-9638bd704385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663bb3a-ac63-47db-8a0d-caed3f6b035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1663bb3a-ac63-47db-8a0d-caed3f6b035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820568841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8236d55d-91e8-48a4-91a1-7f183c6c32a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9225930b1b924695a2c5819c32f68e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:41Z,use_quota=True,user_id='4e88bad5867d487cbbe17939289b120d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517d4bec-eef2-4930-8e0b-65536f4379b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517d4bec-eef2-4930-8e0b-65536f4379b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d65425-8728-49b5-ae8e-56fcb3caa2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d65425-8728-49b5-ae8e-56fcb3caa2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8236d55d-91e8-48a4-91a1-7f183c6c32a0', 'volume_name': 'volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bede09-0316-4f7f-bcab-46b54c8ae117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bede09-0316-4f7f-bcab-46b54c8ae117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e18932-caf0-43aa-a821-e9a48e929d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0', 'volume_size': 1} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:41 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.552s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820568841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8236d55d-91e8-48a4-91a1-7f183c6c32a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9225930b1b924695a2c5819c32f68e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:41Z,use_quota=True,user_id='4e88bad5867d487cbbe17939289b120d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Creating volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:41 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c6ddad-70bc-418d-8530-7fee4303bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57605c34-d288-42b3-abb3-e6db0f4b91f6', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 1073741824 Apr 08 15:52:41 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb72d4bd-bcca-491f-b5b0-08adffc21e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Volume volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 (57605c34-d288-42b3-abb3-e6db0f4b91f6): created successfully Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb72d4bd-bcca-491f-b5b0-08adffc21e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Flow 'volume_create_manager' (1fd72b6e-63fc-4cf6-bc00-4c731b91d49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-047b62d6-3350-4b1c-b1d3-0a70efc4396d tempest-VolumesCloneTest-984219478 None] Created volume successfully. Apr 08 15:52:42 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 1073741824" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:42 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:52:42 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:42 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.534s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e18932-caf0-43aa-a821-e9a48e929d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e54c0c8-04f2-4cac-b369-347027b1a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Volume volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 (8236d55d-91e8-48a4-91a1-7f183c6c32a0): created successfully Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e54c0c8-04f2-4cac-b369-347027b1a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Flow 'volume_create_manager' (8b571d55-43b3-4150-aad2-9638bd704385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-06c9c354-7035-47f4-8afe-2432ea5c1fa3 tempest-VolumesActionsTest-151772336 None] Created volume successfully. Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Flow 'volume_create_manager' (d5956b2b-2ed8-4218-b677-9b9c659acca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbe55aa-289a-46a7-ae59-f6b3f9b360dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbe55aa-289a-46a7-ae59-f6b3f9b360dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-692289655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22874e9f-9e9e-4a51-b570-13e3704f70c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dffa00bb4b44eb81e71e5cebfc7ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=57605c34-d288-42b3-abb3-e6db0f4b91f6,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:43Z,use_quota=True,user_id='cccebf42151f4fc490237cd09c8ad1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d3b4df-fd0a-4777-9cb7-c1866f40ef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d3b4df-fd0a-4777-9cb7-c1866f40ef2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd51f0-f3ac-4ae7-a9ae-e17e2e55862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd51f0-f3ac-4ae7-a9ae-e17e2e55862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22874e9f-9e9e-4a51-b570-13e3704f70c0', 'volume_name': 'volume-22874e9f-9e9e-4a51-b570-13e3704f70c0', 'volume_size': 2, 'source_volid': '57605c34-d288-42b3-abb3-e6db0f4b91f6', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a00d147-8046-479f-9959-e5df7c82fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a00d147-8046-479f-9959-e5df7c82fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83cccab-8223-4bf0-9d12-0a6167632ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:42 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Volume 22874e9f-9e9e-4a51-b570-13e3704f70c0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22874e9f-9e9e-4a51-b570-13e3704f70c0', 'volume_size': 2, 'source_volid': '57605c34-d288-42b3-abb3-e6db0f4b91f6', 'source_volstatus': 'available'} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:42 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Cloning volume 57605c34-d288-42b3-abb3-e6db0f4b91f6 to volume 22874e9f-9e9e-4a51-b570-13e3704f70c0 Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Creating offline snapshot 0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 of volume 57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3baa0e6-e7b8-49f2-b9e4-2100d7e0a072]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:43 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:43 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:43 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.519s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:43 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 1G Apr 08 15:52:43 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:44 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 1G" returned: 0 in 0.625s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:44 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:44 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:44 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.649s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:44 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 is being set with open permissions: ugo+rw Apr 08 15:52:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:44 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:44 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:45 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.559s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:45 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info Apr 08 15:52:45 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (41669cc7-230c-4906-bf10-c7b8a8eb8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb1e5b7-dd7e-4760-b34c-5db14b7d5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb1e5b7-dd7e-4760-b34c-5db14b7d5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-161518446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620d66ba-759c-4342-b174-ce3b61416cb3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:46Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad5c682-016e-41fe-96d5-624178081bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad5c682-016e-41fe-96d5-624178081bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525f887-f8fb-4790-895a-77f47bdcc1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525f887-f8fb-4790-895a-77f47bdcc1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620d66ba-759c-4342-b174-ce3b61416cb3', 'volume_name': 'volume-620d66ba-759c-4342-b174-ce3b61416cb3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981bf325-7aa1-4c34-8deb-4ee860670bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981bf325-7aa1-4c34-8deb-4ee860670bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e65157-b3b2-490d-ac81-784a01329bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:45 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Volume 620d66ba-759c-4342-b174-ce3b61416cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620d66ba-759c-4342-b174-ce3b61416cb3', 'volume_size': 1} Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:45 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info" returned: 0 in 0.500s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:45 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info is being set with open permissions: ugo+rw Apr 08 15:52:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:45 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info Apr 08 15:52:45 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:46 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.info" returned: 0 in 0.444s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] snapshot: 0c3bc5e1-25ee-41ef-9514-9c46ef761bd9, volume: 22874e9f-9e9e-4a51-b570-13e3704f70c0, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f173e9b-6317-41fb-9f7a-330859321a41]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:46 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:46 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:46 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.598s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57605c34-d288-42b3-abb3-e6db0f4b91f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7a25c-6b1f-4925-9174-34d58d39b0d7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:47 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:47 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:47 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:47 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:52:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:47 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 Apr 08 15:52:47 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:49 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0" returned: 0 in 2.186s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0986c-6093-46d9-9f0d-5a232b3a3748]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:49 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:49 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:50 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.699s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:52:50 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Converted 1024.00 MB image at 468.25 MB/s Apr 08 15:52:50 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 is being set with open permissions: ugo+rw Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:50 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 Apr 08 15:52:50 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (1e22265d-7314-4b05-95a1-4562e3de57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae6183-dda6-4a89-90ea-0b9935066b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ae6183-dda6-4a89-90ea-0b9935066b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2089941922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7f50f0-42c2-422e-9854-26a8cdf96982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:51Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8d1d95-f4d7-49f2-8bf0-4323c7b78373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8d1d95-f4d7-49f2-8bf0-4323c7b78373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a3b688-079b-4a3e-9ef9-a4b2ba04ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a3b688-079b-4a3e-9ef9-a4b2ba04ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7f50f0-42c2-422e-9854-26a8cdf96982', 'volume_name': 'volume-6c7f50f0-42c2-422e-9854-26a8cdf96982', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5fb6c9-1f66-43c9-b333-1f2fcbbf31a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5fb6c9-1f66-43c9-b333-1f2fcbbf31a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29389b23-57e1-41b8-8cda-c77595db658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:50 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Volume 6c7f50f0-42c2-422e-9854-26a8cdf96982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7f50f0-42c2-422e-9854-26a8cdf96982', 'volume_size': 1} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:50 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" released by "_copy_volume_from_snapshot" :: held 4.613s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-quobyte-0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Deleting offline snapshot 0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 of volume 57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] snapshot_file for this snap is: volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdac9bd-65e6-4d9d-a3b9-6b808ffe0904]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:51 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:51 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:51 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.526s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57605c34-d288-42b3-abb3-e6db0f4b91f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9daed5-ff62-4645-8565-f7d306c28ee5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:51 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:51 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:51 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:52 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:52 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:52 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:52 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9 Apr 08 15:52:52 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:52 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6.0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-0c3bc5e1-25ee-41ef-9514-9c46ef761bd9" released by "_delete_snapshot" :: held 1.930s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.949s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.248s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-161518446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620d66ba-759c-4342-b174-ce3b61416cb3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:46Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Creating volume 620d66ba-759c-4342-b174-ce3b61416cb3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:52 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83cccab-8223-4bf0-9d12-0a6167632ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22874e9f-9e9e-4a51-b570-13e3704f70c0', 'volume_size': 2, 'source_volid': '57605c34-d288-42b3-abb3-e6db0f4b91f6', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:52 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 1073741824 Apr 08 15:52:52 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af20da4e-c5c0-47a0-ac93-1065d2746adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Volume volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 (22874e9f-9e9e-4a51-b570-13e3704f70c0): created successfully Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af20da4e-c5c0-47a0-ac93-1065d2746adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Flow 'volume_create_manager' (d5956b2b-2ed8-4218-b677-9b9c659acca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-35af33da-08dd-46d2-a8af-8afaac9f1547 tempest-VolumesCloneTest-984219478 None] Created volume successfully. Apr 08 15:52:53 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 1073741824" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:53 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 Apr 08 15:52:53 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-22874e9f-9e9e-4a51-b570-13e3704f70c0-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "cinder-22874e9f-9e9e-4a51-b570-13e3704f70c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" acquired by "delete_volume" :: waited 0.006s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94176648-f17e-4f03-a898-469da0907616]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:53 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 Apr 08 15:52:53 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:53 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2089941922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7f50f0-42c2-422e-9854-26a8cdf96982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:51Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Creating volume 6c7f50f0-42c2-422e-9854-26a8cdf96982 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:53 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e65157-b3b2-490d-ac81-784a01329bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620d66ba-759c-4342-b174-ce3b61416cb3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:53 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 1073741824 Apr 08 15:52:53 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7e97e1-5843-4e9b-892d-a8946f6d1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:53 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Volume volume-620d66ba-759c-4342-b174-ce3b61416cb3 (620d66ba-759c-4342-b174-ce3b61416cb3): created successfully Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7e97e1-5843-4e9b-892d-a8946f6d1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (41669cc7-230c-4906-bf10-c7b8a8eb8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9a50eeae-8a98-4d2d-95c2-7e3f9ef8f674 tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:52:54 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:54 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0 Apr 08 15:52:54 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:54 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 1073741824" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:54 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 Apr 08 15:52:54 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (9427714b-227c-4366-be06-2c3a898ae15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3d55d-2df7-4db7-a2e7-bc4c3de653ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3d55d-2df7-4db7-a2e7-bc4c3de653ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1040496969',display_name='tempest-VolumesGetTest-Volume-2088475713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee35aa9-9246-4391-aa47-0f459e9a871d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:55Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60394951-caf4-4035-bb56-0e2eb3c90613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60394951-caf4-4035-bb56-0e2eb3c90613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:54 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341c93ae-f26b-4d2d-ae6a-56b2a6ee1606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341c93ae-f26b-4d2d-ae6a-56b2a6ee1606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee35aa9-9246-4391-aa47-0f459e9a871d', 'volume_name': 'volume-7ee35aa9-9246-4391-aa47-0f459e9a871d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14a002a-5281-4d1b-836d-247004d32c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14a002a-5281-4d1b-836d-247004d32c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c15b24-2824-4765-91de-db3adfc30123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Volume 7ee35aa9-9246-4391-aa47-0f459e9a871d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee35aa9-9246-4391-aa47-0f459e9a871d', 'volume_size': 1} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22874e9f-9e9e-4a51-b570-13e3704f70c0" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-22874e9f-9e9e-4a51-b570-13e3704f70c0" released by "delete_volume" :: held 1.008s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Created reservations ['eacd9bb8-9d1a-48b3-a9fa-34c6855b0918', '85a9491a-cd7b-47e3-9326-c2a7fec3ff71', '43bbb888-614a-4571-a0b5-35791c1ef995', 'e18f8ac9-331e-4000-8d37-dee23145a930'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:54 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:54 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-57605c34-d288-42b3-abb3-e6db0f4b91f6-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "cinder-57605c34-d288-42b3-abb3-e6db0f4b91f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Acquiring lock "cinder-quobyte-57605c34-d288-42b3-abb3-e6db0f4b91f6" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-57605c34-d288-42b3-abb3-e6db0f4b91f6" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be958afa-493b-4c00-b1b8-d5ffcd76f055]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:54 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982" returned: 0 in 0.510s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1040496969',display_name='tempest-VolumesGetTest-Volume-2088475713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee35aa9-9246-4391-aa47-0f459e9a871d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:55Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Creating volume 7ee35aa9-9246-4391-aa47-0f459e9a871d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:54 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:54 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:54 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29389b23-57e1-41b8-8cda-c77595db658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7f50f0-42c2-422e-9854-26a8cdf96982', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:54 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d 1073741824 Apr 08 15:52:54 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8461d633-5502-4dcd-8c17-98e50c2c2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Volume volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 (6c7f50f0-42c2-422e-9854-26a8cdf96982): created successfully Apr 08 15:52:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8461d633-5502-4dcd-8c17-98e50c2c2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (1e22265d-7314-4b05-95a1-4562e3de57a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:55 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-08a0dbc0-30fb-4de4-a13e-566bc2b7ec2e tempest-VolumesTestJSON-276195739 None] Created volume successfully. Apr 08 15:52:55 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:55 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Deleted volume successfully. Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e65e32a2-b085-4fce-878e-6ef7c3b37079 tempest-VolumesCloneTest-984219478 None] Lock "cinder-22874e9f-9e9e-4a51-b570-13e3704f70c0-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:55 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.489s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:55 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6 Apr 08 15:52:55 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:55 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d 1073741824" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:55 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d Apr 08 15:52:55 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:55 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-57605c34-d288-42b3-abb3-e6db0f4b91f6" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "cinder-quobyte-57605c34-d288-42b3-abb3-e6db0f4b91f6" released by "delete_volume" :: held 1.038s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:55 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Created reservations ['a93fecbc-bfeb-43fb-baef-a151a0fc3397', '3e882f40-c926-4450-a1d7-85bd99e2dfa0', '1019b7c3-13b9-4284-9c94-3afb18e1f2a6', '62a97148-4810-4e7f-b141-6b72c424b77c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:56 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d" returned: 0 in 0.568s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c15b24-2824-4765-91de-db3adfc30123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee35aa9-9246-4391-aa47-0f459e9a871d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523c626-d696-43f9-911c-ff52b7624c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Volume volume-7ee35aa9-9246-4391-aa47-0f459e9a871d (7ee35aa9-9246-4391-aa47-0f459e9a871d): created successfully Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523c626-d696-43f9-911c-ff52b7624c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (9427714b-227c-4366-be06-2c3a898ae15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:56 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:56 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-be7a07f2-5b0d-4088-a468-5e16914b17c9 tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (6aec96d6-63e1-40a9-86b9-e59e99064f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f608a6ef-9e77-4e3c-8d5e-f0771a19f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f608a6ef-9e77-4e3c-8d5e-f0771a19f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-344962263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b94b3d-11d3-400b-be51-c25e344311d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:56Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab320f9-2724-4038-b739-a2d45a2ef13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab320f9-2724-4038-b739-a2d45a2ef13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e53b1bb-24a5-4f10-b4a7-e0324ef0a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e53b1bb-24a5-4f10-b4a7-e0324ef0a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b94b3d-11d3-400b-be51-c25e344311d2', 'volume_name': 'volume-76b94b3d-11d3-400b-be51-c25e344311d2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3251c187-32a7-47ed-970a-a2230bc69549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3251c187-32a7-47ed-970a-a2230bc69549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7f08f8-4987-40b6-92d4-f22a40f0037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:56 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Volume 76b94b3d-11d3-400b-be51-c25e344311d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b94b3d-11d3-400b-be51-c25e344311d2', 'volume_size': 1} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-344962263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b94b3d-11d3-400b-be51-c25e344311d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:56Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Creating volume 76b94b3d-11d3-400b-be51-c25e344311d2 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:56 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:56 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 1073741824 Apr 08 15:52:56 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:56 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.645s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:56 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Deleted volume successfully. Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4c42b461-b3be-4a42-87ac-e88e3f52862f tempest-VolumesCloneTest-984219478 None] Lock "cinder-57605c34-d288-42b3-abb3-e6db0f4b91f6-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-7ee35aa9-9246-4391-aa47-0f459e9a871d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "cinder-7ee35aa9-9246-4391-aa47-0f459e9a871d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-7ee35aa9-9246-4391-aa47-0f459e9a871d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-7ee35aa9-9246-4391-aa47-0f459e9a871d" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c82c7e-d1c1-4310-8b8b-0cdb42d130d0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:56 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d Apr 08 15:52:56 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:57 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 1073741824" returned: 0 in 0.659s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:57 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 Apr 08 15:52:57 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:57 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d" returned: 0 in 0.736s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:57 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d Apr 08 15:52:57 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:57 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2" returned: 0 in 0.614s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7f08f8-4987-40b6-92d4-f22a40f0037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b94b3d-11d3-400b-be51-c25e344311d2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba2abe8-6d11-474c-996e-9c04edd39fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:57 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Volume volume-76b94b3d-11d3-400b-be51-c25e344311d2 (76b94b3d-11d3-400b-be51-c25e344311d2): created successfully Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba2abe8-6d11-474c-996e-9c04edd39fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (6aec96d6-63e1-40a9-86b9-e59e99064f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-767f0b04-3ae9-4649-a4e8-72c2b7edaf51 tempest-VolumesTestJSON-276195739 None] Created volume successfully. Apr 08 15:52:58 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7ee35aa9-9246-4391-aa47-0f459e9a871d" returned: 0 in 0.629s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-7ee35aa9-9246-4391-aa47-0f459e9a871d" released by "delete_volume" :: held 1.412s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Created reservations ['b21d8de3-6b50-4e8e-9baa-8f7dc70ba623', 'be48ca4e-dc7b-4f80-9b00-2762c2b08ef6', 'b972d451-031b-4805-81cb-fc985bf7ccad', '2445ddc9-f1be-4596-b30d-3c2b0a5695da'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:58 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:52:58 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:58 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.511s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:52:58 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:52:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7f8fe842-d110-4f6b-b1ec-aacc9f7c184b tempest-VolumesGetTest-486670504 None] Lock "cinder-7ee35aa9-9246-4391-aa47-0f459e9a871d-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (f6ef7694-6a66-48f0-8f27-1cd7c764f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49207704-afc8-4d10-9ab9-f2dc8348ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49207704-afc8-4d10-9ab9-f2dc8348ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1181257509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d8241a-99aa-44be-b3d4-1af18f285e8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:59Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e782a787-9d10-4604-bdcc-e3c632ce472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e782a787-9d10-4604-bdcc-e3c632ce472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef52f23a-b4d4-447c-92a1-50cc0104e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef52f23a-b4d4-447c-92a1-50cc0104e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d8241a-99aa-44be-b3d4-1af18f285e8d', 'volume_name': 'volume-04d8241a-99aa-44be-b3d4-1af18f285e8d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf25ffeb-c70e-46f0-a6e5-aeb66776ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf25ffeb-c70e-46f0-a6e5-aeb66776ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48302b46-a7da-453d-8746-001fcf44f6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Volume 04d8241a-99aa-44be-b3d4-1af18f285e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d8241a-99aa-44be-b3d4-1af18f285e8d', 'volume_size': 1} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1181257509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d8241a-99aa-44be-b3d4-1af18f285e8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:59Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Creating volume 04d8241a-99aa-44be-b3d4-1af18f285e8d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-58efb6ba-95b8-4a80-8e61-57d2f3d49fbc tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" by "attach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-620d66ba-759c-4342-b174-ce3b61416cb3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:59 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d 1073741824 Apr 08 15:52:59 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-58efb6ba-95b8-4a80-8e61-57d2f3d49fbc tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" acquired by "attach_volume" :: waited 0.028s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "cinder-620d66ba-759c-4342-b174-ce3b61416cb3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (c68b8ce8-3487-4a7b-b700-7e1c46a1f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358433b6-360c-4e44-bed6-3baa21a00fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-620d66ba-759c-4342-b174-ce3b61416cb3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358433b6-360c-4e44-bed6-3baa21a00fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804591020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:59Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40918d8-4143-424a-a2b1-393892d14b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40918d8-4143-424a-a2b1-393892d14b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330f2247-863b-4ce4-a57e-5cda062c9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330f2247-863b-4ce4-a57e-5cda062c9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d', 'volume_name': 'volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1ac8e1-a5bf-4de2-92da-5f35c02b7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1ac8e1-a5bf-4de2-92da-5f35c02b7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a89944-9e82-43c1-bf1b-680f34e43200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Volume 61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d', 'volume_size': 1} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-620d66ba-759c-4342-b174-ce3b61416cb3" acquired by "delete_volume" :: waited 0.039s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f9057-361f-4212-b802-36d28042e226]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-58efb6ba-95b8-4a80-8e61-57d2f3d49fbc tempest-VolumesActionsTest-151772336 None] Attaching volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0 to instance 46b56ffd-5363-4fed-b0e6-3e0cc36fd58b at mountpoint /dev/vdb on host None. Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-58efb6ba-95b8-4a80-8e61-57d2f3d49fbc tempest-VolumesActionsTest-151772336 None] Attach volume completed successfully. Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-58efb6ba-95b8-4a80-8e61-57d2f3d49fbc tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" released by "attach_volume" :: held 0.167s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:59 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 Apr 08 15:52:59 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:59 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d 1073741824" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a3ff49-cd97-4e5e-a043-f4813ab890be tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" by "detach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:52:59 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a3ff49-cd97-4e5e-a043-f4813ab890be tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-65a3ff49-cd97-4e5e-a043-f4813ab890be tempest-VolumesActionsTest-151772336 None] Detaching volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0 from instance 46b56ffd-5363-4fed-b0e6-3e0cc36fd58b. Apr 08 15:52:59 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:52:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-65a3ff49-cd97-4e5e-a043-f4813ab890be tempest-VolumesActionsTest-151772336 None] Detach volume completed successfully. Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a3ff49-cd97-4e5e-a043-f4813ab890be tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:52:59 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3" returned: 0 in 0.572s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:52:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:52:59 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3 Apr 08 15:52:59 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:00 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d" returned: 0 in 0.541s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804591020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97790c4ba6684afebae53db7a4477639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:52:59Z,use_quota=True,user_id='74c83d079ad544c38ce3c1f7e5bc053b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Creating volume 61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:00 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:00 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d 1073741824 Apr 08 15:53:00 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48302b46-a7da-453d-8746-001fcf44f6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d8241a-99aa-44be-b3d4-1af18f285e8d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0a303-9c83-47f1-9571-812dbeb58f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:00 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Volume volume-04d8241a-99aa-44be-b3d4-1af18f285e8d (04d8241a-99aa-44be-b3d4-1af18f285e8d): created successfully Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0a303-9c83-47f1-9571-812dbeb58f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (f6ef7694-6a66-48f0-8f27-1cd7c764f542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-911cfc74-fd83-42b2-a099-f696f25a0a73 tempest-VolumesListTestJSON-1125907160 None] Created volume successfully. Apr 08 15:53:00 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-620d66ba-759c-4342-b174-ce3b61416cb3" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-620d66ba-759c-4342-b174-ce3b61416cb3" released by "delete_volume" :: held 1.059s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Created reservations ['73a41675-34b8-422e-8ed6-39cfa1627ec8', '396ea715-0666-413c-98b7-fc502c7d0d90', 'c9c5251f-0f47-48b4-93c8-ad158b158b51', 'e7c2cae3-f045-4e2c-8371-4d9a1456af83'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:00 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:00 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:00 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d 1073741824" returned: 0 in 0.605s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:00 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d Apr 08 15:53:00 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:01 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-55331aeb-8928-4d5c-b7c4-58fbe1ddc08a tempest-VolumesGetTest-486670504 None] Lock "cinder-620d66ba-759c-4342-b174-ce3b61416cb3-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:01 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a89944-9e82-43c1-bf1b-680f34e43200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0eeb13-c794-4280-a0d7-d34289a31430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Volume volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d (61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d): created successfully Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0eeb13-c794-4280-a0d7-d34289a31430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Flow 'volume_create_manager' (c68b8ce8-3487-4a7b-b700-7e1c46a1f471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2cea3b55-40af-462a-bd55-e6a9dece662c tempest-VolumesTestJSON-276195739 None] Created volume successfully. Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (a27920d7-4a76-48a0-9093-60e2b9f9f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aedfd1-e50d-4639-9fbd-dda3dcf5534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aedfd1-e50d-4639-9fbd-dda3dcf5534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164404781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ca9783-22a4-45db-9313-a78383dbaeee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:01Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd5be04-eb41-4548-9858-d13108371fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd5be04-eb41-4548-9858-d13108371fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ef8d90-113a-47eb-a39e-b5c7758c00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ef8d90-113a-47eb-a39e-b5c7758c00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ca9783-22a4-45db-9313-a78383dbaeee', 'volume_name': 'volume-85ca9783-22a4-45db-9313-a78383dbaeee', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfba994f-c80a-4f5c-ae79-607fd49e8bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfba994f-c80a-4f5c-ae79-607fd49e8bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3eaa1a0-e9c8-4241-85a4-b9344186d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Volume 85ca9783-22a4-45db-9313-a78383dbaeee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ca9783-22a4-45db-9313-a78383dbaeee', 'volume_size': 1} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164404781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ca9783-22a4-45db-9313-a78383dbaeee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:01Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Creating volume 85ca9783-22a4-45db-9313-a78383dbaeee {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:01 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee 1073741824 Apr 08 15:53:01 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (f3226ae3-669e-4b81-b21b-c1a6de16d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae76c296-96fd-4648-903c-1aa650f83d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae76c296-96fd-4648-903c-1aa650f83d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1444626688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a68813c-b959-44a2-9b3b-be3385060c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:02Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7032af-9ea8-4c96-9323-e8d8b45b3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7032af-9ea8-4c96-9323-e8d8b45b3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be445eec-c8e3-463c-830b-1723422b2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be445eec-c8e3-463c-830b-1723422b2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a68813c-b959-44a2-9b3b-be3385060c1a', 'volume_name': 'volume-9a68813c-b959-44a2-9b3b-be3385060c1a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c0ebaf-36f6-480d-8e31-d885143740b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c0ebaf-36f6-480d-8e31-d885143740b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c0760e-a156-4f36-9830-17b2d110ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Volume 9a68813c-b959-44a2-9b3b-be3385060c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a68813c-b959-44a2-9b3b-be3385060c1a', 'volume_size': 1} Apr 08 15:53:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:02 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee 1073741824" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:02 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee Apr 08 15:53:02 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:02 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee" returned: 0 in 0.453s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1444626688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a68813c-b959-44a2-9b3b-be3385060c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:02Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Creating volume 9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:02 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3eaa1a0-e9c8-4241-85a4-b9344186d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ca9783-22a4-45db-9313-a78383dbaeee', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7030bf-de57-4352-8073-554778253b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:02 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a 1073741824 Apr 08 15:53:02 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:UPDATE=242,cinder:DELETE=22,cinder:SELECT=189,cinder:INSERT=61 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:53:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Volume volume-85ca9783-22a4-45db-9313-a78383dbaeee (85ca9783-22a4-45db-9313-a78383dbaeee): created successfully Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7030bf-de57-4352-8073-554778253b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (a27920d7-4a76-48a0-9093-60e2b9f9f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:UPDATE=235,cinder:SELECT=153,cinder:INSERT=52,cinder:DELETE=20 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:53:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a9e11f1a-7ad2-41fa-928e-84be2710580e tempest-VolumesListTestJSON-1125907160 None] Created volume successfully. Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "cinder-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-quobyte-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b808f7-ea9d-4e11-90fd-f4b589a6bde7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:03 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d Apr 08 15:53:03 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:03 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a 1073741824" returned: 0 in 0.669s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:03 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:03 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:03 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:03 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d Apr 08 15:53:03 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:03 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.522s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c0760e-a156-4f36-9830-17b2d110ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a68813c-b959-44a2-9b3b-be3385060c1a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f6d7d8-8690-4324-9d0f-6d97120ab025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Volume volume-9a68813c-b959-44a2-9b3b-be3385060c1a (9a68813c-b959-44a2-9b3b-be3385060c1a): created successfully Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f6d7d8-8690-4324-9d0f-6d97120ab025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (f3226ae3-669e-4b81-b21b-c1a6de16d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (6ae29719-d20d-4119-a677-ebbed091f160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e44b8df-87f4-4d88-aeef-8585857a9b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e44b8df-87f4-4d88-aeef-8585857a9b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1473968685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bef4b54-0e72-4bf8-9746-d9a45b91f7a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:04Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4fdeaa-ac85-44bd-92cd-0e64426fe804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4fdeaa-ac85-44bd-92cd-0e64426fe804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe2deb-9205-4dbb-881a-aa53669c15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe2deb-9205-4dbb-881a-aa53669c15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bef4b54-0e72-4bf8-9746-d9a45b91f7a8', 'volume_name': 'volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc67ada5-d2e1-4019-a1e8-96389f031e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc67ada5-d2e1-4019-a1e8-96389f031e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c27b51-a468-44bd-a9c5-8a83bf00e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Volume 2bef4b54-0e72-4bf8-9746-d9a45b91f7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8', 'volume_size': 1} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1473968685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bef4b54-0e72-4bf8-9746-d9a45b91f7a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca1d8a4e20074921bbe957fe2d73d8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:04Z,use_quota=True,user_id='404e51d76afa4a6ba3f5b4ba9b6f959c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Creating volume 2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:04 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e9704e94-9023-45ca-88a7-21264a4e44bd tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:53:04 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 1073741824 Apr 08 15:53:04 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:04 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d" released by "delete_volume" :: held 1.054s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Created reservations ['94d7369a-5d9d-41e2-a3dd-a2b0f17524e2', '8e9af224-befd-4829-bf95-2af9bb52bc8d', 'fdc3113b-e08d-4e2f-b10a-57ee7c26dd52', '9c447857-180e-4a73-8fc0-91ae275a854a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:04 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:04 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:04 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 1073741824" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:04 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 Apr 08 15:53:04 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:04 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.447s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Deleted volume successfully. Apr 08 15:53:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6acbee1f-4277-4d2c-b5fb-b52e54506062 tempest-VolumesTestJSON-276195739 None] Lock "cinder-61bcb1ae-f55c-40ed-a7fb-841e1e97ca6d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:05 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" returned: 0 in 0.486s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c27b51-a468-44bd-a9c5-8a83bf00e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792bf19d-95af-4ad2-a28b-327514b02990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Volume volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 (2bef4b54-0e72-4bf8-9746-d9a45b91f7a8): created successfully Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792bf19d-95af-4ad2-a28b-327514b02990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Flow 'volume_create_manager' (6ae29719-d20d-4119-a677-ebbed091f160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f9f91aa3-0c3e-4083-9af9-8d6dbaa23de5 tempest-VolumesListTestJSON-1125907160 None] Created volume successfully. Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (bdaa4aab-fd9c-4797-8d70-967f0b50dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5181e8de-1f3e-4a8a-8d38-4ddff866f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5181e8de-1f3e-4a8a-8d38-4ddff866f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1980569243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86745b92-1a28-410c-9a6b-40622c4b973c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9a68813c-b959-44a2-9b3b-be3385060c1a,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:05Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f2233-9149-4842-b8a9-696cd116a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f2233-9149-4842-b8a9-696cd116a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b50524-33b1-464f-9f42-1d321e216be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b50524-33b1-464f-9f42-1d321e216be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '86745b92-1a28-410c-9a6b-40622c4b973c', 'volume_name': 'volume-86745b92-1a28-410c-9a6b-40622c4b973c', 'volume_size': 1, 'source_volid': '9a68813c-b959-44a2-9b3b-be3385060c1a', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c69d89-e23b-4c04-b827-5917a8dceca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c69d89-e23b-4c04-b827-5917a8dceca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca2e16c-c73a-491e-bc8e-c234ba88a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:05 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Volume 86745b92-1a28-410c-9a6b-40622c4b973c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-86745b92-1a28-410c-9a6b-40622c4b973c', 'volume_size': 1, 'source_volid': '9a68813c-b959-44a2-9b3b-be3385060c1a', 'source_volstatus': 'available'} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:05 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Cloning volume 9a68813c-b959-44a2-9b3b-be3385060c1a to volume 86745b92-1a28-410c-9a6b-40622c4b973c Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Creating offline snapshot a29543d9-cc16-4d94-a4b0-14248bdc339d of volume 9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b2e3e-c2e1-47e5-8b7b-85c3001426d6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-76b94b3d-11d3-400b-be51-c25e344311d2-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "cinder-76b94b3d-11d3-400b-be51-c25e344311d2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-quobyte-76b94b3d-11d3-400b-be51-c25e344311d2" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:05 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:05 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-76b94b3d-11d3-400b-be51-c25e344311d2" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e82d6-8e00-4571-8608-8505df29c66c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:05 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 Apr 08 15:53:05 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:05 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:05 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d 1G Apr 08 15:53:05 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:05 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:05 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2 Apr 08 15:53:05 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:06 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d 1G" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68813c-b959-44a2-9b3b-be3385060c1a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:06 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-76b94b3d-11d3-400b-be51-c25e344311d2" returned: 0 in 0.448s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:06 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68813c-b959-44a2-9b3b-be3385060c1a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:06 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-76b94b3d-11d3-400b-be51-c25e344311d2" released by "delete_volume" :: held 0.949s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Created reservations ['f073a6f6-e5c5-49e1-8b90-12e162d65396', '7d697319-9a2b-440f-936d-85280cc7c0d5', '9ceb079d-cc9c-467b-96d7-5358f0d842ba', 'fe9a94e8-6dbe-4d48-8adb-7bf9e8de5c72'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-6c7f50f0-42c2-422e-9854-26a8cdf96982-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:06 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:06 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "cinder-6c7f50f0-42c2-422e-9854-26a8cdf96982-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Acquiring lock "cinder-quobyte-6c7f50f0-42c2-422e-9854-26a8cdf96982" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-6c7f50f0-42c2-422e-9854-26a8cdf96982" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c17ac29-1bff-4634-bb5e-9a0ea3f92abb]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:06 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 Apr 08 15:53:06 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:06 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68813c-b959-44a2-9b3b-be3385060c1a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.582s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:06 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d is being set with open permissions: ugo+rw Apr 08 15:53:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:06 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:06 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:07 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.635s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Deleted volume successfully. Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-80d8c6cd-4d4a-4948-97f9-f5d07462dad5 tempest-VolumesTestJSON-276195739 None] Lock "cinder-76b94b3d-11d3-400b-be51-c25e344311d2-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:07 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:07 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982 Apr 08 15:53:07 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:07 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:07 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info Apr 08 15:53:07 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:07 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6c7f50f0-42c2-422e-9854-26a8cdf96982" returned: 0 in 0.438s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "cinder-quobyte-6c7f50f0-42c2-422e-9854-26a8cdf96982" released by "delete_volume" :: held 1.033s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Created reservations ['ff754716-6da3-4454-b4c8-4b59f486ac14', '6841208b-aec3-4b1c-bc3a-2e3d46838d69', '76eeb3ef-135e-4609-bfd4-7e94a6edd5d3', '9cb1f3d7-4eb4-4a04-b2e2-1df42f3d1e56'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:07 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:07 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:07 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:07 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info is being set with open permissions: ugo+rw Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:07 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info Apr 08 15:53:07 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:08 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Deleted volume successfully. Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-quobyte-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-643cac2c-8547-4fbb-a9b7-867405b9203a tempest-VolumesTestJSON-276195739 None] Lock "cinder-6c7f50f0-42c2-422e-9854-26a8cdf96982-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[231c8942-4730-48fd-9284-709fc3b667d9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:08 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 Apr 08 15:53:08 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:08 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.info" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] snapshot: a29543d9-cc16-4d94-a4b0-14248bdc339d, volume: 86745b92-1a28-410c-9a6b-40622c4b973c, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b37d7-8d4b-4c97-af71-4f221f3714e9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:08 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:08 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:08 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" returned: 0 in 0.487s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:08 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8 Apr 08 15:53:08 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:08 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a68813c-b959-44a2-9b3b-be3385060c1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fde965-a29f-4658-bf99-e349a19c39ed]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:08 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:08 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:09 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" returned: 0 in 0.524s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8" released by "delete_volume" :: held 1.035s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Created reservations ['d1656bdd-57ed-4c02-b7f3-cc1633bcbebd', 'cc797c66-4d5b-47f5-a3c2-f846b74dedc3', '1b22c738-0cc7-4280-bf2a-d7bb05e2fa29', 'ed99f1bd-f4eb-45f7-93bb-7bd42cf57a95'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:09 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:09 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:09 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.677s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:09 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c Apr 08 15:53:09 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:09 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.527s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Deleted volume successfully. Apr 08 15:53:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-268b67b3-625b-4101-a965-09e72754e27b tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-2bef4b54-0e72-4bf8-9746-d9a45b91f7a8-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-85ca9783-22a4-45db-9313-a78383dbaeee-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-85ca9783-22a4-45db-9313-a78383dbaeee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-quobyte-85ca9783-22a4-45db-9313-a78383dbaeee" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-85ca9783-22a4-45db-9313-a78383dbaeee" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a27f3-8bb9-4454-921c-d31fe6897a78]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:10 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee Apr 08 15:53:10 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:11 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c" returned: 0 in 2.484s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:11 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaa01ca-3b35-44ed-855c-37ecf77e2c49]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:11 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee" returned: 0 in 1.418s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:11 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee Apr 08 15:53:11 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:11 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:11 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:12 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85ca9783-22a4-45db-9313-a78383dbaeee" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-85ca9783-22a4-45db-9313-a78383dbaeee" released by "delete_volume" :: held 1.922s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Created reservations ['a7bda0e1-e566-43d3-86da-df62664bbf05', 'f809cc8a-9d01-42f4-91b0-ff7e69688f49', '3d71a6fd-d5fb-4fa9-a850-0fe9882d9cb9', 'e96d6815-5531-4741-be64-f944a1f0ecd3'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:12 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:12 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:12 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.679s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:53:12 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Converted 1024.00 MB image at 412.05 MB/s Apr 08 15:53:12 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c is being set with open permissions: ugo+rw Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:12 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c Apr 08 15:53:12 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-04d8241a-99aa-44be-b3d4-1af18f285e8d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-04d8241a-99aa-44be-b3d4-1af18f285e8d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "cinder-quobyte-04d8241a-99aa-44be-b3d4-1af18f285e8d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-04d8241a-99aa-44be-b3d4-1af18f285e8d" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddfe9c6-2f15-42c3-92e1-8bddcb1e5e73]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:13 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d Apr 08 15:53:13 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:13 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.572s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Deleted volume successfully. Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4aa6e6fa-3f82-4aaf-abff-1889f15151a6 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-85ca9783-22a4-45db-9313-a78383dbaeee-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:13 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c" returned: 0 in 0.578s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" released by "_copy_volume_from_snapshot" :: held 4.945s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-a29543d9-cc16-4d94-a4b0-14248bdc339d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-a29543d9-cc16-4d94-a4b0-14248bdc339d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Deleting offline snapshot a29543d9-cc16-4d94-a4b0-14248bdc339d of volume 9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] snapshot_file for this snap is: volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026177b-24cf-49f7-9890-70ab8ccceb2a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:13 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:13 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:13 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d" returned: 0 in 0.648s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:13 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d Apr 08 15:53:13 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:13 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.572s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a68813c-b959-44a2-9b3b-be3385060c1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4293e-70f0-4d8f-8ee4-8137e5bd8cce]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:13 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:13 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:14 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04d8241a-99aa-44be-b3d4-1af18f285e8d" returned: 0 in 0.502s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-quobyte-04d8241a-99aa-44be-b3d4-1af18f285e8d" released by "delete_volume" :: held 1.174s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Created reservations ['c7387837-d5ca-4722-bc47-16aa303da022', '7466e5ed-7605-4eec-85a5-a956deb6fe26', '300edc23-6ab0-4c79-b1fb-a0d6c12bc52d', '52011a4b-266d-4f26-b28f-ea2fc2cdd961'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:14 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:14 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:14 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.739s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:14 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:14 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:14 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.514s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Deleted volume successfully. Apr 08 15:53:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4d4c2c2a-9057-4e13-8081-29f3811b7f36 tempest-VolumesListTestJSON-1125907160 None] Lock "cinder-04d8241a-99aa-44be-b3d4-1af18f285e8d-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3d343693-d1d4-4a6d-9b55-0760b3b60602 tempest-GroupsTest-729850078 None] Group tempest-Group1-36526628: creating Apr 08 15:53:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3d343693-d1d4-4a6d-9b55-0760b3b60602 tempest-GroupsTest-729850078 None] Group tempest-Group1-36526628: created successfully Apr 08 15:53:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3d343693-d1d4-4a6d-9b55-0760b3b60602 tempest-GroupsTest-729850078 None] Create group completed successfully. Apr 08 15:53:15 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:15 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d Apr 08 15:53:15 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a.a29543d9-cc16-4d94-a4b0-14248bdc339d" returned: 0 in 0.525s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:15 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-a29543d9-cc16-4d94-a4b0-14248bdc339d" released by "_delete_snapshot" :: held 2.483s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.514s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca2e16c-c73a-491e-bc8e-c234ba88a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86745b92-1a28-410c-9a6b-40622c4b973c', 'volume_size': 1, 'source_volid': '9a68813c-b959-44a2-9b3b-be3385060c1a', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be37453b-12af-4880-922c-4b141ccc92b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:15 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Volume volume-86745b92-1a28-410c-9a6b-40622c4b973c (86745b92-1a28-410c-9a6b-40622c4b973c): created successfully Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be37453b-12af-4880-922c-4b141ccc92b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (bdaa4aab-fd9c-4797-8d70-967f0b50dac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:15 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-06d3fe54-0a04-40c4-912d-fcb3bb7fe690 tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:53:16 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cb134434-cbfd-47d6-9168-650ccf44991f tempest-GroupsTest-729850078 None] Group tempest-Group2-284960101: creating Apr 08 15:53:16 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cb134434-cbfd-47d6-9168-650ccf44991f tempest-GroupsTest-729850078 None] Group tempest-Group2-284960101: created successfully Apr 08 15:53:16 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cb134434-cbfd-47d6-9168-650ccf44991f tempest-GroupsTest-729850078 None] Create group completed successfully. Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Flow 'volume_create_manager' (90549495-cb52-45c4-bf6d-d0dcae3c7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc55e5e-da18-4a79-bc8c-cb9e857f1ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc55e5e-da18-4a79-bc8c-cb9e857f1ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2069342950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1005db-71aa-41b0-b0a0-8cbac73d62ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3509429ec18240679e3d3e27a15cae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='f3a2eb245e49490697c05719ad7c32c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec7b9f-6b49-49d9-ab67-8433d969224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec7b9f-6b49-49d9-ab67-8433d969224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0face535-b936-4582-b181-7949e87119eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0face535-b936-4582-b181-7949e87119eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1005db-71aa-41b0-b0a0-8cbac73d62ad', 'volume_name': 'volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b7d051-cc82-4a39-b6a8-c17b031983fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b7d051-cc82-4a39-b6a8-c17b031983fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e1b6fe-4623-4c3e-806b-7c0fd44a8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:16 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Volume ed1005db-71aa-41b0-b0a0-8cbac73d62ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad', 'volume_size': 1} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2069342950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1005db-71aa-41b0-b0a0-8cbac73d62ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3509429ec18240679e3d3e27a15cae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='f3a2eb245e49490697c05719ad7c32c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Creating volume ed1005db-71aa-41b0-b0a0-8cbac73d62ad {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:16 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:16 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad 1073741824 Apr 08 15:53:16 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (24389668-9c43-4ab7-9f33-79cea6143e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8accbbdc-ac47-4a32-9397-9edd47da10d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8accbbdc-ac47-4a32-9397-9edd47da10d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-240633205',display_name='tempest-VolumesGetTest-Volume-1415099299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7387ec34-6713-42e3-9de4-cf7a25f28dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3cd94-4d26-483c-b07f-2092f19cf7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3cd94-4d26-483c-b07f-2092f19cf7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eea03ba-991e-4b0b-be78-2c9295c35f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eea03ba-991e-4b0b-be78-2c9295c35f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7387ec34-6713-42e3-9de4-cf7a25f28dfa', 'volume_name': 'volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52617572-7667-4a7e-a167-3550c8c8e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52617572-7667-4a7e-a167-3550c8c8e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19262c34-5fdc-45ad-8ebc-fe0b1b24deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Volume 7387ec34-6713-42e3-9de4-cf7a25f28dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa', 'volume_size': 1} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (891a8317-a055-4921-8367-4dd79a47d541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09270ab6-a684-4bf8-b326-9aefcc86c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09270ab6-a684-4bf8-b326-9aefcc86c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141685831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58ff83b1-786d-4a82-9f27-dc2c61a2ac39,host='devstack@QuobyteHD#QuobyteHD',id=3791064e-15eb-469b-bcf1-b326117f6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e39bbf4b-a04e-486f-92eb-07af80fef56b),volume_type_id=e39bbf4b-a04e-486f-92eb-07af80fef56b)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0af2d8-2f69-4e74-847f-e85e12cfe876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0af2d8-2f69-4e74-847f-e85e12cfe876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6b3dfb-a32d-4be9-bea5-5824d2c09b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6b3dfb-a32d-4be9-bea5-5824d2c09b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3791064e-15eb-469b-bcf1-b326117f6a0b', 'volume_name': 'volume-3791064e-15eb-469b-bcf1-b326117f6a0b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07e3824-81e9-421c-b5fb-47cbe98f5ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07e3824-81e9-421c-b5fb-47cbe98f5ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d6d1e9-4ce4-4352-93ee-4478af0ab1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:17 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Volume 3791064e-15eb-469b-bcf1-b326117f6a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3791064e-15eb-469b-bcf1-b326117f6a0b', 'volume_size': 1} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:17 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad 1073741824" returned: 0 in 0.739s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:17 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad Apr 08 15:53:17 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:18 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" returned: 0 in 0.419s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-240633205',display_name='tempest-VolumesGetTest-Volume-1415099299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7387ec34-6713-42e3-9de4-cf7a25f28dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Creating volume 7387ec34-6713-42e3-9de4-cf7a25f28dfa {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:18 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e1b6fe-4623-4c3e-806b-7c0fd44a8d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:18 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa 1073741824 Apr 08 15:53:18 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ff8e58-ab97-474b-ab38-b1b5c3348074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:18 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Volume volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad (ed1005db-71aa-41b0-b0a0-8cbac73d62ad): created successfully Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ff8e58-ab97-474b-ab38-b1b5c3348074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Flow 'volume_create_manager' (90549495-cb52-45c4-bf6d-d0dcae3c7af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7ed85a13-d611-49aa-b448-f47f014e8cd7 tempest-VolumesNegativeTest-702843376 None] Created volume successfully. Apr 08 15:53:18 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa 1073741824" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:18 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa Apr 08 15:53:18 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:19 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa" returned: 0 in 0.441s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58ff83b1-786d-4a82-9f27-dc2c61a2ac39,created_at=2026-04-08T13:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141685831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58ff83b1-786d-4a82-9f27-dc2c61a2ac39,host='devstack@QuobyteHD#QuobyteHD',id=3791064e-15eb-469b-bcf1-b326117f6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:17Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e39bbf4b-a04e-486f-92eb-07af80fef56b),volume_type_id=e39bbf4b-a04e-486f-92eb-07af80fef56b)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Creating volume 3791064e-15eb-469b-bcf1-b326117f6a0b {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:19 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19262c34-5fdc-45ad-8ebc-fe0b1b24deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e12dc3-8654-4c60-9d1c-f0648a7a50ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:19 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b 1073741824 Apr 08 15:53:19 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:19 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Volume volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa (7387ec34-6713-42e3-9de4-cf7a25f28dfa): created successfully Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e12dc3-8654-4c60-9d1c-f0648a7a50ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (24389668-9c43-4ab7-9f33-79cea6143e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ca53f7ea-c1bd-4442-9fde-5708d49a1c1a tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-7387ec34-6713-42e3-9de4-cf7a25f28dfa-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "cinder-7387ec34-6713-42e3-9de4-cf7a25f28dfa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-7387ec34-6713-42e3-9de4-cf7a25f28dfa" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-7387ec34-6713-42e3-9de4-cf7a25f28dfa" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f2d015-f3fa-4985-8fbb-1f1dd9e6f1e5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:19 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa Apr 08 15:53:19 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:19 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b 1073741824" returned: 0 in 0.590s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:19 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b Apr 08 15:53:19 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:20 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:20 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa Apr 08 15:53:20 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:20 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d6d1e9-4ce4-4352-93ee-4478af0ab1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3791064e-15eb-469b-bcf1-b326117f6a0b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add1f3d4-812a-40ab-ad8e-f13b1badfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Volume volume-3791064e-15eb-469b-bcf1-b326117f6a0b (3791064e-15eb-469b-bcf1-b326117f6a0b): created successfully Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add1f3d4-812a-40ab-ad8e-f13b1badfae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (891a8317-a055-4921-8367-4dd79a47d541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bfa6d91c-6053-48f3-9b12-f4ce95f73b1a tempest-GroupsTest-729850078 None] Created volume successfully. Apr 08 15:53:20 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7387ec34-6713-42e3-9de4-cf7a25f28dfa" returned: 0 in 0.547s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-7387ec34-6713-42e3-9de4-cf7a25f28dfa" released by "delete_volume" :: held 1.156s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Created reservations ['41012aab-86b5-4307-8b3d-4e92d5ed447b', 'd21aaa5e-2475-4f19-abf1-6c94d247d35c', '22a26c7e-41f3-4ed9-90ca-22fbbf473c24', '4518aec7-1df8-4831-8c03-64785ac1af4e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:20 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:20 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Acquiring lock "cinder-quobyte-3791064e-15eb-469b-bcf1-b326117f6a0b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-3791064e-15eb-469b-bcf1-b326117f6a0b" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60200a9e-7d09-4b53-8eba-d9211f46d63a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:21 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b Apr 08 15:53:21 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:21 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.561s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-757b7635-c1fb-47fb-8d3c-3c5558fe3f86 tempest-VolumesGetTest-486670504 None] Lock "cinder-7387ec34-6713-42e3-9de4-cf7a25f28dfa-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:21 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:21 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:21 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:21 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b Apr 08 15:53:21 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-86745b92-1a28-410c-9a6b-40622c4b973c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "cinder-86745b92-1a28-410c-9a6b-40622c4b973c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa6e84-ce9f-45ea-8352-666bb0aea442]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:22 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c Apr 08 15:53:22 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:22 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.550s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:22 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3791064e-15eb-469b-bcf1-b326117f6a0b" returned: 0 in 0.586s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-3791064e-15eb-469b-bcf1-b326117f6a0b" released by "delete_volume" :: held 1.212s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Created reservations ['ef98fe41-8352-4aa8-a7de-48f7aa7b23a5'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:22 devstack cinder-volume[82216]: WARNING cinder.quota [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1985579382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1985579382, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:53:22 devstack cinder-volume[82216]: WARNING cinder.quota [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1985579382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1985579382, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Created reservations ['d729ce58-a29f-4f96-a4c4-060073e0d0c9', '3b6895b3-7257-43f9-bb62-0745a8ab8285', '3581632f-e98f-4901-98ad-8bc9baf52217', '9b69ecd3-f1e8-4dc9-98ce-c12f0eb32bae'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:22 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:22 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:22 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c" returned: 0 in 0.599s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2fa1715c-3f77-4510-b626-118b81f3b556 tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" by "attach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:22 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c Apr 08 15:53:22 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2fa1715c-3f77-4510-b626-118b81f3b556 tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" acquired by "attach_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2fa1715c-3f77-4510-b626-118b81f3b556 tempest-VolumesActionsTest-151772336 None] Attaching volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0 to instance 049d4115-6b71-4004-9e3b-2e64867cfb55 at mountpoint /dev/vdb on host None. Apr 08 15:53:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2fa1715c-3f77-4510-b626-118b81f3b556 tempest-VolumesActionsTest-151772336 None] Attach volume completed successfully. Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2fa1715c-3f77-4510-b626-118b81f3b556 tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0" released by "attach_volume" :: held 0.063s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:22 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a01f4af4-c6ce-47f8-b347-2aee1a220459 tempest-GroupsTest-729850078 None] Delete group completed successfully. Apr 08 15:53:23 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-86745b92-1a28-410c-9a6b-40622c4b973c" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-86745b92-1a28-410c-9a6b-40622c4b973c" released by "delete_volume" :: held 1.170s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Created reservations ['b090ae91-43ec-4f7b-a899-33d9b629fbc5', 'dc8cb77c-c9cb-4040-ac89-0bd06d2d2ebc', 'bd517f7a-0857-4a4b-8626-7cc689ae387a', '79799139-38f0-400e-a2ad-8f4df178553d'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:23 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:23 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-324c5be2-3d1c-4e99-a323-f1187f39283c tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" by "detach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-324c5be2-3d1c-4e99-a323-f1187f39283c tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-324c5be2-3d1c-4e99-a323-f1187f39283c tempest-VolumesActionsTest-151772336 None] Detaching volume 8236d55d-91e8-48a4-91a1-7f183c6c32a0 from instance 049d4115-6b71-4004-9e3b-2e64867cfb55. Apr 08 15:53:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-324c5be2-3d1c-4e99-a323-f1187f39283c tempest-VolumesActionsTest-151772336 None] Detach volume completed successfully. Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-324c5be2-3d1c-4e99-a323-f1187f39283c tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Created reservations ['4d751c80-59a3-4e05-aa7a-ad5fa11ecce0'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:23 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:23 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:23 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-659f3832-86f0-47c1-8ecb-47b02ec6a1e2 tempest-VolumesGetTest-486670504 None] Lock "cinder-86745b92-1a28-410c-9a6b-40622c4b973c-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:23 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-157801d5-6e05-4b3f-b0ee-482ec3359041 tempest-GroupsTest-729850078 None] Delete group completed successfully. Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-9a68813c-b959-44a2-9b3b-be3385060c1a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "cinder-9a68813c-b959-44a2-9b3b-be3385060c1a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-9a68813c-b959-44a2-9b3b-be3385060c1a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-9a68813c-b959-44a2-9b3b-be3385060c1a" acquired by "delete_volume" :: waited 0.028s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2cb28-0eda-43e9-b735-095c82a8dbbc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:24 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:24 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:24 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.603s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:24 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a Apr 08 15:53:24 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8d521bf7-37d7-4e47-9ed9-caccaf822a50 tempest-GroupsTest-729850078 None] Group tempest-GroupsTest-Group-389743961: creating Apr 08 15:53:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8d521bf7-37d7-4e47-9ed9-caccaf822a50 tempest-GroupsTest-729850078 None] Group tempest-GroupsTest-Group-389743961: created successfully Apr 08 15:53:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8d521bf7-37d7-4e47-9ed9-caccaf822a50 tempest-GroupsTest-729850078 None] Create group completed successfully. Apr 08 15:53:25 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9a68813c-b959-44a2-9b3b-be3385060c1a" returned: 0 in 0.483s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-9a68813c-b959-44a2-9b3b-be3385060c1a" released by "delete_volume" :: held 1.144s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Created reservations ['e5e4114f-d9c2-48b0-af52-5ae3e0222732', '5def0923-2888-4aeb-9523-127a0254b003', 'ce67d6f4-7d94-4fc6-8c74-94049b594d1a', '63ba9b6b-30de-4bcf-8efd-b13b23292695'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:25 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:25 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:25 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.513s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:25 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-17b84006-ed6e-4cb9-bff3-b47e8c4efa9e tempest-VolumesGetTest-486670504 None] Lock "cinder-9a68813c-b959-44a2-9b3b-be3385060c1a-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (23deaf8a-cc04-462c-9b4c-0efc87bbb234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0610bf9-c0ba-4249-a1f4-9f0ebbc6c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0610bf9-c0ba-4249-a1f4-9f0ebbc6c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119821057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,host='devstack@QuobyteHD#QuobyteHD',id=755ea97a-12ef-4cb7-89ae-d8fe7b70140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:26Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e11f248-8cde-4ca2-8e29-6abd2f3adc64),volume_type_id=3e11f248-8cde-4ca2-8e29-6abd2f3adc64)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5883cc05-ae20-4026-9e2f-2d2e933cac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5883cc05-ae20-4026-9e2f-2d2e933cac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c8788-4e0f-4aef-99b4-2761f5d31a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c8788-4e0f-4aef-99b4-2761f5d31a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755ea97a-12ef-4cb7-89ae-d8fe7b70140e', 'volume_name': 'volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0aea67-2cd7-4a9c-ba4f-33f913fbbeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0aea67-2cd7-4a9c-ba4f-33f913fbbeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeb5d85-a2d0-4aee-af5c-863f8707f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Volume 755ea97a-12ef-4cb7-89ae-d8fe7b70140e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e', 'volume_size': 1} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,created_at=2026-04-08T13:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119821057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,host='devstack@QuobyteHD#QuobyteHD',id=755ea97a-12ef-4cb7-89ae-d8fe7b70140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:26Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e11f248-8cde-4ca2-8e29-6abd2f3adc64),volume_type_id=3e11f248-8cde-4ca2-8e29-6abd2f3adc64)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Creating volume 755ea97a-12ef-4cb7-89ae-d8fe7b70140e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:26 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e 1073741824 Apr 08 15:53:26 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (07108cf6-3a67-4c47-81a5-aaee02e46ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed7654-4724-45cd-9384-5511c749ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed7654-4724-45cd-9384-5511c749ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1096377385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ec423c-93a3-4a7b-b129-6e4c6cb57a93,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:27Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c3716-8fb9-4bb2-8b4c-699af4681203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c3716-8fb9-4bb2-8b4c-699af4681203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:26 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a1d9a2-46ff-442f-93ca-d1076ec30bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG cinder.image.glance [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Creating Keystone auth plugin from conf {{(pid=82216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 15:53:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e 1073741824" returned: 0 in 0.609s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:27 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e Apr 08 15:53:27 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a1d9a2-46ff-442f-93ca-d1076ec30bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56ec423c-93a3-4a7b-b129-6e4c6cb57a93', 'volume_name': 'volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd71a62-05da-48a7-9fa8-932670b23e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd71a62-05da-48a7-9fa8-932670b23e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d121b3-7a2c-46ba-ba5b-251e27eb7586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Trying to clone 56ec423c-93a3-4a7b-b129-6e4c6cb57a93 from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]). {{(pid=82216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 15:53:27 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Image download 20.69 MB at 20.69 MB/s Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9be739-c21e-40a2-974a-6a0114084c87]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:27 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD Apr 08 15:53:27 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:27 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" returned: 0 in 0.468s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeb5d85-a2d0-4aee-af5c-863f8707f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99823bc-68ed-48a1-ad0d-02042a32845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Volume volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e (755ea97a-12ef-4cb7-89ae-d8fe7b70140e): created successfully Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99823bc-68ed-48a1-ad0d-02042a32845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (23deaf8a-cc04-462c-9b4c-0efc87bbb234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0ef8e96d-a4cc-4aed-a27a-0212b4fd5074 tempest-GroupsTest-729850078 None] Created volume successfully. Apr 08 15:53:27 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 is fetched for user 39863df9826c488a844fc4b6d24bc8d1. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[333aca50-2fdb-4a78-a358-42a389f9576e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:27 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD Apr 08 15:53:27 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:28 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1096377385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ec423c-93a3-4a7b-b129-6e4c6cb57a93,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:27Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Creating volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:28 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:28 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1073741824 Apr 08 15:53:28 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (70657345-4479-4515-be31-c7141564f87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d177b2-50a9-4c3f-a1e6-ed452257fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d177b2-50a9-4c3f-a1e6-ed452257fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686186979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,host='devstack@QuobyteHD#QuobyteHD',id=41e0ce6c-9055-4935-8cf7-338d07fe2e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:29Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e11f248-8cde-4ca2-8e29-6abd2f3adc64),volume_type_id=3e11f248-8cde-4ca2-8e29-6abd2f3adc64)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a872b92a-43b6-4057-9f88-e4a2ba1e1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a872b92a-43b6-4057-9f88-e4a2ba1e1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db220b5f-b1a7-4289-98f8-eb2e5f288c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db220b5f-b1a7-4289-98f8-eb2e5f288c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e0ce6c-9055-4935-8cf7-338d07fe2e79', 'volume_name': 'volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67cbf10-5025-4d36-8636-a06d44e0dbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67cbf10-5025-4d36-8636-a06d44e0dbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cec39d5-db47-45b2-99d2-f1e6cc7f932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:28 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Volume 41e0ce6c-9055-4935-8cf7-338d07fe2e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79', 'volume_size': 1} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:28 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1073741824" returned: 0 in 0.586s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:29 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:29 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:29 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 0 in 0.424s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,created_at=2026-04-08T13:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686186979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05a5f0fa-4aa7-4b69-8d4a-48fc4d407d32,host='devstack@QuobyteHD#QuobyteHD',id=41e0ce6c-9055-4935-8cf7-338d07fe2e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebede64ea06f43a8a216cfb1a86b8f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:29Z,use_quota=True,user_id='8a2fd9af96f54f2f8ae7acf2ffd94991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e11f248-8cde-4ca2-8e29-6abd2f3adc64),volume_type_id=3e11f248-8cde-4ca2-8e29-6abd2f3adc64)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Creating volume 41e0ce6c-9055-4935-8cf7-338d07fe2e79 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:29 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:29 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 1073741824 Apr 08 15:53:29 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Attempting download of e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fcd2a-d837-4ef2-ab6c-8994b3e2ee9f]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:29 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d Apr 08 15:53:29 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:29 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:29 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 1073741824" returned: 0 in 0.564s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:30 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d Apr 08 15:53:30 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:30 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 Apr 08 15:53:30 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:30 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d" returned: 1 in 0.967s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_pox8l64d' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54edae-10c4-4d33-82a4-22e878ef6551]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:30 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79" returned: 0 in 0.945s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cec39d5-db47-45b2-99d2-f1e6cc7f932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab21b35-4474-4810-a5e3-0530be9d7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Volume volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 (41e0ce6c-9055-4935-8cf7-338d07fe2e79): created successfully Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab21b35-4474-4810-a5e3-0530be9d7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Flow 'volume_create_manager' (70657345-4479-4515-be31-c7141564f87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-449819a8-ff0e-4305-bf99-0a121cc1609d tempest-GroupsTest-729850078 None] Created volume successfully. Apr 08 15:53:31 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD Apr 08 15:53:31 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e4f1c5-6c60-4cad-bd9f-0182cb40571c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:31 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD" returned: 0 in 0.639s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] e5804f13-1c8e-4c0f-8b39-f65c9607d678 was qcow2, converting to raw {{(pid=82216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 15:53:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:31 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:31 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:31 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:31 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:32 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.536s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f334b-1548-4860-81ef-fd25659a89f7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:32 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0fb3ac30-80e4-4a47-83ea-2b2110af2179 tempest-GroupsTest-729850078 None] Update group completed successfully. Apr 08 15:53:32 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:32 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:32 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 0 in 0.932s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_82oh0nmddevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:53:32 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Converted 112.00 MB image at 112.00 MB/s Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:32 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1G Apr 08 15:53:32 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:32 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.698s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.b5906bd3-d182-457e-bfc0-94d5e512bfact5su1gj7.img {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:32 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.b5906bd3-d182-457e-bfc0-94d5e512bfact5su1gj7.img Apr 08 15:53:32 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:33 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 1G" returned: 0 in 0.571s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:33 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f20b3-a872-4d20-a387-2c57c3b5723d]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:33 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:33 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ee39fcd0-eea2-4ea6-a0f3-bd06e9229c29 tempest-GroupsTest-729850078 None] Update group completed successfully. Apr 08 15:53:34 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 0 in 1.194s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:34 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:34 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:35 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.b5906bd3-d182-457e-bfc0-94d5e512bfact5su1gj7.img" returned: 0 in 2.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8ef131-5257-4961-a8de-d7d1bfcbe71a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:35 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:35 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:35 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 1 in 1.281s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Downloaded image e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93 successfully. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 for user 39863df9826c488a844fc4b6d24bc8d1 is deleted. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Marking volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93 as bootable. {{(pid=82216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Copying metadata from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 to 56ec423c-93a3-4a7b-b129-6e4c6cb57a93. {{(pid=82216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Creating volume glance metadata for volume 56ec423c-93a3-4a7b-b129-6e4c6cb57a93 backed by image e5804f13-1c8e-4c0f-8b39-f65c9607d678 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Acquiring lock "cinder-quobyte-41e0ce6c-9055-4935-8cf7-338d07fe2e79" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-41e0ce6c-9055-4935-8cf7-338d07fe2e79" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514b668-dce3-4c51-bbb0-ee15c1d66718]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d121b3-7a2c-46ba-ba5b-251e27eb7586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ffae98-f33e-4b97-967a-8bc13f632e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:35 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Volume volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 (56ec423c-93a3-4a7b-b129-6e4c6cb57a93): created successfully Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ffae98-f33e-4b97-967a-8bc13f632e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (07108cf6-3a67-4c47-81a5-aaee02e46ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d9f315ed-1363-417c-8cd2-6df95ae4b904 tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:53:35 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 Apr 08 15:53:35 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:36 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.702s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.b5906bd3-d182-457e-bfc0-94d5e512bfact5su1gj7.img {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:53:36 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Converted 1024.00 MB image at 395.47 MB/s Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] b5906bd3-d182-457e-bfc0-94d5e512bfac was raw, no need to convert to raw {{(pid=82216) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 08 15:53:36 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79" returned: 0 in 0.555s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:36 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79 Apr 08 15:53:36 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:36 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-41e0ce6c-9055-4935-8cf7-338d07fe2e79" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-41e0ce6c-9055-4935-8cf7-338d07fe2e79" released by "delete_volume" :: held 1.086s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Acquiring lock "cinder-quobyte-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b36474-4c24-474b-88ce-5f1f687522c1]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:36 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e Apr 08 15:53:36 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (0a46be73-ffc7-48ec-a678-18926993a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b18a42-51de-4390-96e1-c05a5ed54e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b18a42-51de-4390-96e1-c05a5ed54e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025444922',display_name='tempest-VolumesGetTest-Volume-216908469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9bd40f-ca74-4f3a-b21e-1070f8a3c393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:37Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f914af9-6c4e-4207-b816-ba55bec539c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f914af9-6c4e-4207-b816-ba55bec539c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfef000-dbe9-452e-b41d-83ede473e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfef000-dbe9-452e-b41d-83ede473e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9bd40f-ca74-4f3a-b21e-1070f8a3c393', 'volume_name': 'volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e09758-62e5-416c-90d4-4eee67e78b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e09758-62e5-416c-90d4-4eee67e78b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a896820-9493-4f7e-8bb1-100ecaa496bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:37 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Volume 9f9bd40f-ca74-4f3a-b21e-1070f8a3c393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393', 'volume_size': 1} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:37 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" returned: 0 in 0.589s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:37 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e Apr 08 15:53:37 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:37 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "cinder-quobyte-755ea97a-12ef-4cb7-89ae-d8fe7b70140e" released by "delete_volume" :: held 1.123s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Created reservations ['f90c687a-f762-4317-8417-96b993ceb684'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:37 devstack cinder-volume[82216]: WARNING cinder.quota [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-178299981 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-178299981, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:53:37 devstack cinder-volume[82216]: WARNING cinder.quota [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-178299981 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-178299981, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:53:37 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Created reservations ['5a97ac0c-f97b-40e0-8e3b-f10f8ca8e4b2', '44514570-e325-4b22-8fa8-2a5cacf49a51', '995e9401-921d-43ee-83a2-b71f09fb06c2', '26b45743-a5c8-4cdf-9f4f-426f89329483'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Created reservations ['f8ef228f-21ef-4377-a0a0-2f72de39441b', '7f882156-8ee8-43e7-be07-8b3772c6017d', 'cbe30866-96c7-4344-806c-69053e0314ed', 'a595ea89-f5cb-47dd-bd95-2b29649fedfd'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:38 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:38 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:38 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:38 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:38 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6ef91515-b539-4592-bc88-a277407ca150 tempest-GroupsTest-729850078 None] Delete group completed successfully. Apr 08 15:53:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a5e39716-dcd3-449b-931f-d39901a86b73 tempest-GroupsV314Test-2111889307 None] Group tempest-GroupsV314Test-Group-95870854: creating Apr 08 15:53:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a5e39716-dcd3-449b-931f-d39901a86b73 tempest-GroupsV314Test-2111889307 None] Group tempest-GroupsV314Test-Group-95870854: created successfully Apr 08 15:53:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a5e39716-dcd3-449b-931f-d39901a86b73 tempest-GroupsV314Test-2111889307 None] Create group completed successfully. Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Flow 'volume_create_manager' (34126250-08ac-4c85-8077-f74ee879d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128b477-7437-4492-8d1f-0782c7191013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128b477-7437-4492-8d1f-0782c7191013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1508202971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25eb0f5c-f707-412b-b196-5e2d660756ce,host='devstack@QuobyteHD#QuobyteHD',id=0f01771a-5f22-4db9-bd14-dc3907f5af9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dc2605801745438264f3b666d28e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:44Z,use_quota=True,user_id='ab8f177a14b74d5b920a5fe18052938b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91b1266-e53b-439e-b254-0d8df484663a),volume_type_id=a91b1266-e53b-439e-b254-0d8df484663a)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa903205-fcda-4044-a1ea-af792aded9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa903205-fcda-4044-a1ea-af792aded9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc8783a-26dd-4d75-979e-70ada633d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc8783a-26dd-4d75-979e-70ada633d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f01771a-5f22-4db9-bd14-dc3907f5af9b', 'volume_name': 'volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db3e14-8ebf-4e6e-8a1e-5ef6d8c9b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db3e14-8ebf-4e6e-8a1e-5ef6d8c9b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448ebafd-3a72-416e-bc46-aaebf1858075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:44 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Volume 0f01771a-5f22-4db9-bd14-dc3907f5af9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b', 'volume_size': 1} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Acquiring lock "cinder-ed1005db-71aa-41b0-b0a0-8cbac73d62ad-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "cinder-ed1005db-71aa-41b0-b0a0-8cbac73d62ad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Acquiring lock "cinder-quobyte-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "cinder-quobyte-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d98e0-ce05-46e6-b30b-d00e18b5aff0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:44 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad Apr 08 15:53:44 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:45 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" returned: 0 in 0.507s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:45 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad Apr 08 15:53:45 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:45 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" returned: 0 in 0.492s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "cinder-quobyte-ed1005db-71aa-41b0-b0a0-8cbac73d62ad" released by "delete_volume" :: held 1.027s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Created reservations ['e41fe4ce-9587-4d40-868d-81077066f781', '0b298577-1f7d-4e86-a385-f8450b1b9645', '0ad5e47d-3bf9-4b54-a26a-147673068db2', 'c70cd483-313e-4ee7-b490-30a791d9f57c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:45 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:45 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:46 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:46 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:46 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Deleted volume successfully. Apr 08 15:53:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8b6ea3b1-f114-4d96-8530-9cc2d6db106b tempest-VolumesNegativeTest-702843376 None] Lock "cinder-ed1005db-71aa-41b0-b0a0-8cbac73d62ad-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.480s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Uploaded volume to glance image-id: b5906bd3-d182-457e-bfc0-94d5e512bfac. {{(pid=82216) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.800s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025444922',display_name='tempest-VolumesGetTest-Volume-216908469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9bd40f-ca74-4f3a-b21e-1070f8a3c393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeee06939044051be0f064418d97109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:37Z,use_quota=True,user_id='39863df9826c488a844fc4b6d24bc8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Creating volume 9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:47 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:47 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 1073741824 Apr 08 15:53:47 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:47 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-97ba1fd9-1262-4c4d-b00c-41879beb66e0 tempest-VolumesActionsTest-151772336 None] Copy volume to image completed successfully. Apr 08 15:53:47 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 1073741824" returned: 0 in 0.542s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:47 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 Apr 08 15:53:47 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:48 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" returned: 0 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.898s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25eb0f5c-f707-412b-b196-5e2d660756ce,created_at=2026-04-08T13:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1508202971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25eb0f5c-f707-412b-b196-5e2d660756ce,host='devstack@QuobyteHD#QuobyteHD',id=0f01771a-5f22-4db9-bd14-dc3907f5af9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dc2605801745438264f3b666d28e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:44Z,use_quota=True,user_id='ab8f177a14b74d5b920a5fe18052938b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91b1266-e53b-439e-b254-0d8df484663a),volume_type_id=a91b1266-e53b-439e-b254-0d8df484663a)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Creating volume 0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a896820-9493-4f7e-8bb1-100ecaa496bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b 1073741824 Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e938a6-6c12-4aee-a452-f6ef99fd21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Volume volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 (9f9bd40f-ca74-4f3a-b21e-1070f8a3c393): created successfully Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e938a6-6c12-4aee-a452-f6ef99fd21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Flow 'volume_create_manager' (0a46be73-ffc7-48ec-a678-18926993a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0bbf14e9-e1dc-465f-9716-7f30ef143667 tempest-VolumesGetTest-486670504 None] Created volume successfully. Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (e357fcbf-4c9a-4e08-9509-ad98e1bf826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09466ca-dc73-4619-97bc-71e0149f01a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09466ca-dc73-4619-97bc-71e0149f01a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115196050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5eacf6-61cf-4999-a757-9b7ed56f7bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:48Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a632c928-ed37-4e3a-97fc-0f2fd105a60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a632c928-ed37-4e3a-97fc-0f2fd105a60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9911d6ef-7018-4a12-b1e4-0ae257f70a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9911d6ef-7018-4a12-b1e4-0ae257f70a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5eacf6-61cf-4999-a757-9b7ed56f7bc9', 'volume_name': 'volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a835a1a-3b30-4ece-9701-3e5a0a51d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a835a1a-3b30-4ece-9701-3e5a0a51d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4fadd6-a89b-48f5-b956-d0d30776c17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Volume 9c5eacf6-61cf-4999-a757-9b7ed56f7bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9', 'volume_size': 1} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:48 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b 1073741824" returned: 0 in 0.518s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:48 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:53:48 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (499248de-d645-4430-ab61-6c1f72b34859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e8f08-1e30-44b6-8628-95787dad3fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e8f08-1e30-44b6-8628-95787dad3fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532933327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4920620-d130-48ca-b2a8-df0067043c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d7c9b-5ba5-4a5e-be32-00fb6e469c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d7c9b-5ba5-4a5e-be32-00fb6e469c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ade557-14a5-4624-8f6a-0fdab3fe87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ade557-14a5-4624-8f6a-0fdab3fe87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4920620-d130-48ca-b2a8-df0067043c32', 'volume_name': 'volume-d4920620-d130-48ca-b2a8-df0067043c32', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df82fae-976c-4efc-b5ac-342cb93dbd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df82fae-976c-4efc-b5ac-342cb93dbd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08e4ab8-3cec-40e1-9f88-eda24ccda68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Volume d4920620-d130-48ca-b2a8-df0067043c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4920620-d130-48ca-b2a8-df0067043c32', 'volume_size': 1} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (d363c48e-3122-406d-b7a9-0f8dcbb54104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829688af-be04-432d-9d61-f6872502509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829688af-be04-432d-9d61-f6872502509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506969226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ab467c-af93-474d-a5a1-fb75c56646c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47719286-18f4-4c40-8a4a-2d08cf23e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47719286-18f4-4c40-8a4a-2d08cf23e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d5c03f-fb24-4c79-925b-e04e5db78943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d5c03f-fb24-4c79-925b-e04e5db78943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ab467c-af93-474d-a5a1-fb75c56646c4', 'volume_name': 'volume-99ab467c-af93-474d-a5a1-fb75c56646c4', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1919089c-3b12-4f20-954f-048883960187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1919089c-3b12-4f20-954f-048883960187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec3ec3-e7b2-485f-9428-3bb59dfb6471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Volume 99ab467c-af93-474d-a5a1-fb75c56646c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ab467c-af93-474d-a5a1-fb75c56646c4', 'volume_size': 1} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "cinder-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bbc6e0-a459-4e17-a693-1b52bbfc5fe9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (a80abda7-bdbb-4a56-acfe-bf5bb5b2dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa693d-78f8-437f-892b-782fdaa67202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:49 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 Apr 08 15:53:49 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa693d-78f8-437f-892b-782fdaa67202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139095884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808ef303-4ad8-4e80-ac72-8320fec05ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808ef303-4ad8-4e80-ac72-8320fec05ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4302000d-87d5-4530-8934-1dbde19dd440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4302000d-87d5-4530-8934-1dbde19dd440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b', 'volume_name': 'volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f27362-e40e-44f5-9018-0cea0a733145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f27362-e40e-44f5-9018-0cea0a733145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b2013f-642d-4d1a-9953-e025df648a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Volume 6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b', 'volume_size': 1} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.537s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.978s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448ebafd-3a72-416e-bc46-aaebf1858075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e639c5-b47c-4969-b7ff-a6cd3585fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dfb3eb-7dd2-4a71-9828-683785c3af99]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Volume volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b (0f01771a-5f22-4db9-bd14-dc3907f5af9b): created successfully Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e639c5-b47c-4969-b7ff-a6cd3585fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Flow 'volume_create_manager' (34126250-08ac-4c85-8077-f74ee879d670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-98ed8d5f-4cff-411b-baec-813b885a5260 tempest-GroupsV314Test-2111889307 None] Created volume successfully. Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (f2ae5b10-c060-4a15-befd-2def88db8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38ca06-65c5-4b1e-b46c-3656abc41d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38ca06-65c5-4b1e-b46c-3656abc41d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609466220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530c6cac-80c7-4683-8dac-fd4202ae2d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:49 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ed79a9-def3-43b1-aecf-caf662f556a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ed79a9-def3-43b1-aecf-caf662f556a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63862ad-c497-4ab9-88d6-c50fe2962959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63862ad-c497-4ab9-88d6-c50fe2962959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530c6cac-80c7-4683-8dac-fd4202ae2d2d', 'volume_name': 'volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d02797-e1e8-43de-b13a-c19845d7aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d02797-e1e8-43de-b13a-c19845d7aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c66897b-643e-4af8-9128-f82eab1b3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Volume 530c6cac-80c7-4683-8dac-fd4202ae2d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d', 'volume_size': 1} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:49 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" returned: 0 in 0.557s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:49 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393 Apr 08 15:53:49 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:49 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.543s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ce3ee-4eca-47df-a089-bd4a9f89a315]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:49 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:49 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:50 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393" released by "delete_volume" :: held 1.009s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Created reservations ['577d1a49-ac0b-4477-a817-91a4521f829b', '01f5b574-f94a-438a-9311-9f83c6d85fc3', 'b0653a10-9d42-4375-bdc8-3ab53f4d3c13', '004ffac5-6f55-41ac-97b4-2edf85c8d3cf'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:50 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:50 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:50 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:50 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img Apr 08 15:53:50 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:50 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.453s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:50 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b7c6d4a4-9066-49d4-95e0-171930b363d5 tempest-VolumesGetTest-486670504 None] Lock "cinder-9f9bd40f-ca74-4f3a-b21e-1070f8a3c393-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-56ec423c-93a3-4a7b-b129-6e4c6cb57a93-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "cinder-56ec423c-93a3-4a7b-b129-6e4c6cb57a93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Acquiring lock "cinder-quobyte-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82220e-2d07-4457-91df-63feaa24b0e6]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:51 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:51 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:52 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img" returned: 0 in 2.012s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3d806d-1430-4b42-861f-ea00b9b172da]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:52 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:52 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:52 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 0 in 0.911s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:52 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:52 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:52 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.631s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:53:52 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Converted 1024.00 MB image at 508.64 MB/s Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] 799b4482-19e5-4c9f-a10f-5bc608f964b4 was raw, converting to qcow2 {{(pid=82216) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc52250c-78f7-472e-8834-906a4249f6d0]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:52 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 1 in 0.496s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:53:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:52 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img Apr 08 15:53:52 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:52 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93 Apr 08 15:53:52 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:53 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:53 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "cinder-quobyte-56ec423c-93a3-4a7b-b129-6e4c6cb57a93" released by "delete_volume" :: held 1.906s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Created reservations ['a2a38e77-1052-40e2-b524-53121b14b55d', '248c3a22-4ee3-44fc-86e3-a2d33ac1e645', '686261a5-5fd4-4380-9fa9-9285608b5dc7', '0e95195f-3718-48ae-912f-16aa3fbcb064'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:53 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img Apr 08 15:53:53 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:53 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:53 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:53 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img" returned: 1 in 0.546s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img /opt/stack/data/cinder/conversion/vol_upload_atx68qzz {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:53 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:53 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img /opt/stack/data/cinder/conversion/vol_upload_atx68qzz Apr 08 15:53:53 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Deleted volume successfully. Apr 08 15:53:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c4101d84-7a62-4bf1-a549-8c8f670407a7 tempest-VolumesGetTest-486670504 None] Lock "cinder-56ec423c-93a3-4a7b-b129-6e4c6cb57a93-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:54 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img /opt/stack/data/cinder/conversion/vol_upload_atx68qzz" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:54 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Image conversion details: src /opt/stack/data/cinder/conversion/8236d55d-91e8-48a4-91a1-7f183c6c32a0.temp_image.799b4482-19e5-4c9f-a10f-5bc608f964b41trhfack.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_atx68qzz {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:53:54 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 08 15:53:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d0224-1b5e-484d-9865-de63da7f4e4a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atx68qzz {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:54 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atx68qzz Apr 08 15:53:54 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:54 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atx68qzz" returned: 0 in 0.521s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.654s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Uploaded volume to glance image-id: 799b4482-19e5-4c9f-a10f-5bc608f964b4. {{(pid=82216) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.373s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115196050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5eacf6-61cf-4999-a757-9b7ed56f7bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:48Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Creating volume 9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:55 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:55 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 1073741824 Apr 08 15:53:55 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:55 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-55f32f46-5d79-4885-866b-f857901535d3 tempest-VolumesActionsTest-151772336 None] Copy volume to image completed successfully. Apr 08 15:53:56 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 1073741824" returned: 0 in 0.526s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:56 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 Apr 08 15:53:56 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Flow 'volume_create_manager' (d0287a3b-241b-4b92-8dca-2f35b3d10323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342331c6-bb1b-41cd-be40-3fdce4170d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342331c6-bb1b-41cd-be40-3fdce4170d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2054696463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a95f88d-a935-4c2c-b8c0-839a28c8ec20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06b09cb28c74555bc9eb03a445da2f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:57Z,use_quota=True,user_id='c0ec57be241542a381a72f4ab807053f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada35410-e9f4-4c1c-93ab-c3250f87c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada35410-e9f4-4c1c-93ab-c3250f87c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cd5356-129b-4685-8b75-5a1eb35d1002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cd5356-129b-4685-8b75-5a1eb35d1002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a95f88d-a935-4c2c-b8c0-839a28c8ec20', 'volume_name': 'volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20', 'volume_size': 2}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eced2bf-64ce-46ca-b696-61bc996a66b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eced2bf-64ce-46ca-b696-61bc996a66b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400f84c7-d093-4244-ae8a-51d04b046e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:56 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Volume 5a95f88d-a935-4c2c-b8c0-839a28c8ec20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20', 'volume_size': 2} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Acquiring lock "cinder-quobyte-8236d55d-91e8-48a4-91a1-7f183c6c32a0" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:53:56 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" returned: 0 in 0.577s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "cinder-quobyte-8236d55d-91e8-48a4-91a1-7f183c6c32a0" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.263s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532933327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4920620-d130-48ca-b2a8-df0067043c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Creating volume d4920620-d130-48ca-b2a8-df0067043c32 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:56 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[377166bf-efd0-45ef-871d-4461c1778ce5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:53:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:56 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 1073741824 Apr 08 15:53:56 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4fadd6-a89b-48f5-b956-d0d30776c17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be51a317-5121-4e9f-a0a1-506d1b664d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:57 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Volume volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 (9c5eacf6-61cf-4999-a757-9b7ed56f7bc9): created successfully Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be51a317-5121-4e9f-a0a1-506d1b664d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (e357fcbf-4c9a-4e08-9509-ad98e1bf826d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-55291b2e-d6ec-429f-b8bf-0c40501d575b tempest-CreateVolumesFromImageTest-2146283876 None] Created volume successfully. Apr 08 15:53:57 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:57 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:57 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 1073741824" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:57 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.491s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:57 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 Apr 08 15:53:57 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:57 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0 Apr 08 15:53:57 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:57 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-8236d55d-91e8-48a4-91a1-7f183c6c32a0" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "cinder-quobyte-8236d55d-91e8-48a4-91a1-7f183c6c32a0" released by "delete_volume" :: held 0.939s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:57 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.955s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506969226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ab467c-af93-474d-a5a1-fb75c56646c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Creating volume 99ab467c-af93-474d-a5a1-fb75c56646c4 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:57 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08e4ab8-3cec-40e1-9f88-eda24ccda68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4920620-d130-48ca-b2a8-df0067043c32', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c9114-3479-4fe7-b918-a3f775bd7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:57 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 1073741824 Apr 08 15:53:57 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:57 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Volume volume-d4920620-d130-48ca-b2a8-df0067043c32 (d4920620-d130-48ca-b2a8-df0067043c32): created successfully Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c9114-3479-4fe7-b918-a3f775bd7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (499248de-d645-4430-ab61-6c1f72b34859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7e5ca498-80fe-44ae-ba63-448fb03337bb tempest-CreateVolumesFromImageTest-2146283876 None] Created volume successfully. Apr 08 15:53:57 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Created reservations ['a7b6479f-3a86-4302-89a1-0a6a81d44ba0', '7fed9072-967d-4413-a412-dddd2d8e5cea', '2fc0db7c-8fa1-45cf-889b-e5cbd4ab98bd', 'e6decf61-be95-46cd-8d62-b3238999e849'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:58 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:53:58 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:58 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 1073741824" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:58 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.398s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:53:58 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Deleted volume successfully. Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7730276e-ca7d-46fa-bcdb-91311d4dde61 tempest-VolumesActionsTest-151772336 None] Lock "cinder-8236d55d-91e8-48a4-91a1-7f183c6c32a0-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:58 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 Apr 08 15:53:58 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:58 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4" returned: 0 in 0.402s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.701s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139095884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Creating volume 6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:58 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec3ec3-e7b2-485f-9428-3bb59dfb6471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ab467c-af93-474d-a5a1-fb75c56646c4', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b150c87c-0d31-4e76-ae53-1bedca406b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:58 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b 1073741824 Apr 08 15:53:58 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:58 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Volume volume-99ab467c-af93-474d-a5a1-fb75c56646c4 (99ab467c-af93-474d-a5a1-fb75c56646c4): created successfully Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b150c87c-0d31-4e76-ae53-1bedca406b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (d363c48e-3122-406d-b7a9-0f8dcbb54104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:58 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-06ed24f6-7c38-4838-ab57-3675f3cdac32 tempest-CreateVolumesFromImageTest-2146283876 None] Created volume successfully. Apr 08 15:53:59 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b 1073741824" returned: 0 in 0.495s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:59 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b Apr 08 15:53:59 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:59 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" returned: 0 in 0.426s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.498s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609466220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530c6cac-80c7-4683-8dac-fd4202ae2d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fffb0e4c64c45dcbd63bdbab772f1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:49Z,use_quota=True,user_id='16d9e219abd048a798c372f5d368f487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Creating volume 530c6cac-80c7-4683-8dac-fd4202ae2d2d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:53:59 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b2013f-642d-4d1a-9953-e025df648a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:59 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d 1073741824 Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4808dcab-aa71-42d7-8900-1360bfd79928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:53:59 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:53:59 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Volume volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b (6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b): created successfully Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4808dcab-aa71-42d7-8900-1360bfd79928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:53:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (a80abda7-bdbb-4a56-acfe-bf5bb5b2dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:53:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-95b10dad-9621-455e-947b-cd24c37ae2b2 tempest-CreateVolumesFromImageTest-2146283876 None] Created volume successfully. Apr 08 15:54:00 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d 1073741824" returned: 0 in 0.552s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:00 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d Apr 08 15:54:00 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:00 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d" returned: 0 in 0.428s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.399s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:00 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Cloning volume 0f01771a-5f22-4db9-bd14-dc3907f5af9b to volume 63f0e03a-da81-4f7d-b798-a02810b55e27 Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c66897b-643e-4af8-9128-f82eab1b3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0721b0a-0f13-41ac-8a23-23bd0b1bb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Creating offline snapshot 67403f0b-1955-471e-adaa-95cf1543c869 of volume 0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:54:00 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Volume volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d (530c6cac-80c7-4683-8dac-fd4202ae2d2d): created successfully Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0721b0a-0f13-41ac-8a23-23bd0b1bb1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Flow 'volume_create_manager' (f2ae5b10-c060-4a15-befd-2def88db8619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-29e39d90-3b4f-43b4-aebc-391bb7f400be tempest-CreateVolumesFromImageTest-2146283876 None] Created volume successfully. Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf61031-7438-4213-9a90-296fc4c8f3c4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:00 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:00 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-530c6cac-80c7-4683-8dac-fd4202ae2d2d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-530c6cac-80c7-4683-8dac-fd4202ae2d2d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-quobyte-530c6cac-80c7-4683-8dac-fd4202ae2d2d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-530c6cac-80c7-4683-8dac-fd4202ae2d2d" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ee397-da04-4699-83ba-a46dff9abca6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:01 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d Apr 08 15:54:01 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:01 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:01 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 1G Apr 08 15:54:01 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:01 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d" returned: 0 in 0.596s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:01 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d Apr 08 15:54:01 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:02 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 1G" returned: 0 in 0.611s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:02 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:02 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:02 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-530c6cac-80c7-4683-8dac-fd4202ae2d2d" returned: 0 in 0.487s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-530c6cac-80c7-4683-8dac-fd4202ae2d2d" released by "delete_volume" :: held 1.117s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Created reservations ['86bbbffa-ac15-47b0-981a-6e9792a7f1e5', '2665910f-f343-4aae-8ec8-eacb7c024678', 'a7fbe790-d4cc-4492-9349-740298b3eb94', '262d1bd3-da79-4a31-b9fa-3c4d42a78bd5'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:02 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:02 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:02 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:02 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:02 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:02 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:02 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.443s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Deleted volume successfully. Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=173,cinder:UPDATE=208,cinder:DELETE=16,cinder:INSERT=53 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:54:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e84813df-b26b-4ac6-b327-ecff8526a78b tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-530c6cac-80c7-4683-8dac-fd4202ae2d2d-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:DELETE=15,cinder:UPDATE=202,cinder:SELECT=159,cinder:INSERT=52 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:03 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (cfee1645-4fb9-4d83-97c9-f553aef4e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150e149-8720-4376-84b8-d3b24979907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.489s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150e149-8720-4376-84b8-d3b24979907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857614474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be590303-2b68-499b-ac2a-5163c2e41a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:03Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224d1bc5-6399-4356-ad83-cee540e3a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224d1bc5-6399-4356-ad83-cee540e3a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64570387-9a00-41fc-973f-65f2fcc8c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64570387-9a00-41fc-973f-65f2fcc8c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be590303-2b68-499b-ac2a-5163c2e41a02', 'volume_name': 'volume-be590303-2b68-499b-ac2a-5163c2e41a02', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e0ae62-5a8b-42e8-9811-b9ba8ba7d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e0ae62-5a8b-42e8-9811-b9ba8ba7d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292e2094-e97e-4c4a-b4c7-904e51c53dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume be590303-2b68-499b-ac2a-5163c2e41a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be590303-2b68-499b-ac2a-5163c2e41a02', 'volume_size': 1} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:03 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info Apr 08 15:54:03 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-quobyte-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeba1d7-02d7-4733-a261-5ded934f99c5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:03 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b Apr 08 15:54:03 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:03 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:03 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:03 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info Apr 08 15:54:03 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:03 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:03 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b Apr 08 15:54:03 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:04 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.info" returned: 0 in 0.439s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Acquiring lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] snapshot: 67403f0b-1955-471e-adaa-95cf1543c869, volume: 63f0e03a-da81-4f7d-b798-a02810b55e27, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c68fc0-4265-4736-ad6e-9d5fe4cec625]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:04 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:04 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:04 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" returned: 0 in 0.467s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b" released by "delete_volume" :: held 0.960s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Created reservations ['1982c12d-6060-46b1-ad0b-35a03ef483a1', '496b8132-ba04-4b1f-a780-496baf860c39', 'ac7f0dd9-de61-4d8c-bf3e-71d665a7e49a', '59dccb8f-4e9a-4fa7-968e-55697c04bcf5'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:04 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:04 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-99ab467c-af93-474d-a5a1-fb75c56646c4-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-99ab467c-af93-474d-a5a1-fb75c56646c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-quobyte-99ab467c-af93-474d-a5a1-fb75c56646c4" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-99ab467c-af93-474d-a5a1-fb75c56646c4" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f088397-e749-4161-954a-981599c5d02b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:04 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 Apr 08 15:54:04 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:04 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.514s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28d0735-97bb-4a15-8d71-afee0a091ca0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:04 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:04 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:04 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.497s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Deleted volume successfully. Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f7d8bd38-aa21-47c4-ab3c-c9302593fcd5 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-6211ac7f-a336-4b8b-bb03-c42d3d7a9e4b-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:04 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4" returned: 0 in 0.507s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:05 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4 Apr 08 15:54:05 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:05 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.467s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:05 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 Apr 08 15:54:05 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:05 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99ab467c-af93-474d-a5a1-fb75c56646c4" returned: 0 in 0.421s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-99ab467c-af93-474d-a5a1-fb75c56646c4" released by "delete_volume" :: held 0.949s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Created reservations ['fb365bd4-c010-43f0-b0d3-d33932634706', '68dff819-c21b-441a-ae12-dd16a9e348c6', '9b940a9b-206e-46cf-b8ec-564cc36841be', '4c9d23e2-879a-4f73-ace2-ced0dc801261'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:05 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:05 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-d4920620-d130-48ca-b2a8-df0067043c32-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-d4920620-d130-48ca-b2a8-df0067043c32-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-quobyte-d4920620-d130-48ca-b2a8-df0067043c32" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-d4920620-d130-48ca-b2a8-df0067043c32" acquired by "delete_volume" :: waited 0.029s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1dfaf0-0247-499e-a28d-0fb6de0e25f0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:06 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 Apr 08 15:54:06 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:07 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.427s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Deleted volume successfully. Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e2df9bf3-c2b7-4e86-a7d8-be587e73b083 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-99ab467c-af93-474d-a5a1-fb75c56646c4-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:07 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32" returned: 0 in 1.307s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:07 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27" returned: 0 in 2.123s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:07 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32 Apr 08 15:54:07 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c48f6-a8ee-410d-8c69-f7e82af1c6e1]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:07 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:07 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:07 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-d4920620-d130-48ca-b2a8-df0067043c32" returned: 0 in 0.413s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-d4920620-d130-48ca-b2a8-df0067043c32" released by "delete_volume" :: held 1.765s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Created reservations ['222b8797-e8ff-497e-ab31-ec35e703aa5b', 'c14c3e71-ae17-4ed4-bcf8-62a3b25357ef', 'd84d35a1-07f2-42a9-a5ff-0186fe154558', 'fb381ecf-8207-4af1-900e-74d523883a22'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:07 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:07 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:07 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.595s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:54:07 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Converted 1024.00 MB image at 481.80 MB/s Apr 08 15:54:07 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 15:54:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:07 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 Apr 08 15:54:07 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:08 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.412s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Deleted volume successfully. Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5c047e9f-6ca4-4290-a61a-93bf0feaf2d0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-d4920620-d130-48ca-b2a8-df0067043c32-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "cinder-quobyte-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2224b32f-57f3-4006-8692-b10e84a7fa1d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:08 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 Apr 08 15:54:08 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:08 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" released by "_copy_volume_from_snapshot" :: held 4.229s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Acquiring lock "cinder-quobyte-67403f0b-1955-471e-adaa-95cf1543c869" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-67403f0b-1955-471e-adaa-95cf1543c869" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Deleting offline snapshot 67403f0b-1955-471e-adaa-95cf1543c869 of volume 0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] snapshot_file for this snap is: volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[097fc1fe-818d-4913-9d32-d0bab54af490]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:08 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:08 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:08 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:08 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9 Apr 08 15:54:08 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:08 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60882dd4-ab22-40d1-a315-9817bf9ea702]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:08 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:08 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:09 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" returned: 0 in 0.398s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-quobyte-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9" released by "delete_volume" :: held 0.882s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Created reservations ['2eb0e21b-8277-4969-82bd-eb20f9a7f84f', '199429eb-d474-4f1c-a03d-5d5e09005b2e', '3ef11992-4029-4938-9693-c2b18f0edc9b', '8ae0cd81-e1d1-469e-9610-4768f21c0533'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:09 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:09 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:09 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.508s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:09 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:09 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:09 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.431s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Deleted volume successfully. Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eab8030c-5713-41d5-9ad0-e4f33ce310e0 tempest-CreateVolumesFromImageTest-2146283876 None] Lock "cinder-9c5eacf6-61cf-4999-a757-9b7ed56f7bc9-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:09 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.482s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:09 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869 Apr 08 15:54:09 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:10 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b.67403f0b-1955-471e-adaa-95cf1543c869" returned: 0 in 0.414s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-67403f0b-1955-471e-adaa-95cf1543c869" released by "_delete_snapshot" :: held 1.931s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.389s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.289s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2054696463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a95f88d-a935-4c2c-b8c0-839a28c8ec20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06b09cb28c74555bc9eb03a445da2f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:53:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:53:57Z,use_quota=True,user_id='c0ec57be241542a381a72f4ab807053f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Creating volume 5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:10 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 2147483648 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:10 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 2147483648 Apr 08 15:54:10 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2b7c64aa-051e-483c-8943-291c57cc706f tempest-GroupsV314Test-2111889307 None] Create group from source-group-25eb0f5c-f707-412b-b196-5e2d660756ce completed successfully. Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Acquiring lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e978630-f09b-4c42-8a77-7363ad242593]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:10 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 Apr 08 15:54:10 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:10 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 2147483648" returned: 0 in 0.626s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:10 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 Apr 08 15:54:10 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (67c75c0b-23f5-4375-9747-bab0c92748a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c04b13-b894-49b9-8a6c-6a193bf0de0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c04b13-b894-49b9-8a6c-6a193bf0de0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430663182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2111f4-88c7-42d6-986f-349ca0380838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:11Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5bf77a-a158-44de-921e-60b9613d345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5bf77a-a158-44de-921e-60b9613d345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab770dc3-e441-4090-bf9c-d2c33dc170f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab770dc3-e441-4090-bf9c-d2c33dc170f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2111f4-88c7-42d6-986f-349ca0380838', 'volume_name': 'volume-7b2111f4-88c7-42d6-986f-349ca0380838', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12b559-183a-4147-8ca8-626ec2cd8636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12b559-183a-4147-8ca8-626ec2cd8636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a4e7fb-0861-4a6b-b73c-6e0635b89220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume 7b2111f4-88c7-42d6-986f-349ca0380838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2111f4-88c7-42d6-986f-349ca0380838', 'volume_size': 1} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:11 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27" returned: 0 in 0.549s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:11 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27 Apr 08 15:54:11 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:11 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" returned: 0 in 0.426s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.229s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857614474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be590303-2b68-499b-ac2a-5163c2e41a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:03Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:11 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400f84c7-d093-4244-ae8a-51d04b046e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20', 'volume_size': 2}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 1073741824 Apr 08 15:54:11 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05e3dda-9916-4470-bb1a-740894145a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:11 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Volume volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 (5a95f88d-a935-4c2c-b8c0-839a28c8ec20): created successfully Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05e3dda-9916-4470-bb1a-740894145a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Flow 'volume_create_manager' (d0287a3b-241b-4b92-8dca-2f35b3d10323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9f556de3-8fc6-4c54-b80d-8eed2a686ae5 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Created volume successfully. Apr 08 15:54:11 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-63f0e03a-da81-4f7d-b798-a02810b55e27" returned: 0 in 0.405s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-63f0e03a-da81-4f7d-b798-a02810b55e27" released by "delete_volume" :: held 0.974s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Created reservations ['3b805b93-0618-40b9-a31b-7cd1d3cebb9c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:11 devstack cinder-volume[82216]: WARNING cinder.quota [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-513615355 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-513615355, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:54:11 devstack cinder-volume[82216]: WARNING cinder.quota [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-513615355 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-513615355, it is now deprecated. Please use the default quota class for default quota. Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Created reservations ['b48886d9-ee14-4860-8e93-9031a4ce9afa', 'd5de63de-36a7-4693-9b92-9b6c256d1eaf', 'e881ac57-1788-4e89-bce8-622736658d44', '35785d37-8138-4786-bf6b-9b9bd7620d87'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:11 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:11 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:11 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 1073741824" returned: 0 in 0.569s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:11 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 Apr 08 15:54:11 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:12 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ad174a9e-e639-4dc2-bdab-90b50a9a4ce5 tempest-GroupsV314Test-2111889307 None] Delete group completed successfully. Apr 08 15:54:12 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02" returned: 0 in 0.417s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430663182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2111f4-88c7-42d6-986f-349ca0380838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:11Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume 7b2111f4-88c7-42d6-986f-349ca0380838 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:12 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292e2094-e97e-4c4a-b4c7-904e51c53dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be590303-2b68-499b-ac2a-5163c2e41a02', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:12 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 1073741824 Apr 08 15:54:12 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e11521-c8a4-4bb5-a74c-08aafd49f32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:12 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-be590303-2b68-499b-ac2a-5163c2e41a02 (be590303-2b68-499b-ac2a-5163c2e41a02): created successfully Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e11521-c8a4-4bb5-a74c-08aafd49f32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (cfee1645-4fb9-4d83-97c9-f553aef4e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8128a3c1-1d8c-4e91-a062-830822f90b9e tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Acquiring lock "cinder-quobyte-0f01771a-5f22-4db9-bd14-dc3907f5af9b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-0f01771a-5f22-4db9-bd14-dc3907f5af9b" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c1ea0-4f2f-44f1-989d-25a12bcba19d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:12 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 1073741824" returned: 0 in 0.569s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:12 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 Apr 08 15:54:12 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:12 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:12 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:13 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.469s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:13 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.491s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a4e7fb-0861-4a6b-b73c-6e0635b89220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2111f4-88c7-42d6-986f-349ca0380838', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:13 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b Apr 08 15:54:13 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd15a2a-0624-48f2-8ba9-3dbe54222370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Creating offline snapshot df5aaa5c-ebb9-4833-b340-17900b505a13 of volume 5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:54:13 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-7b2111f4-88c7-42d6-986f-349ca0380838 (7b2111f4-88c7-42d6-986f-349ca0380838): created successfully Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd15a2a-0624-48f2-8ba9-3dbe54222370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (67c75c0b-23f5-4375-9747-bab0c92748a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fee87f-2202-48a9-a0c9-15fb077c57df]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8eb184ca-2004-4fe3-9a59-e53687880310 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:13 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 Apr 08 15:54:13 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:13 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0f01771a-5f22-4db9-bd14-dc3907f5af9b" returned: 0 in 0.401s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Lock "cinder-quobyte-0f01771a-5f22-4db9-bd14-dc3907f5af9b" released by "delete_volume" :: held 0.928s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Created reservations ['fef7e14d-dd59-4047-a31f-7bc5f4dd5d5b'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Created reservations ['f26a545d-f730-4a60-8748-0d540bff5884', '50c626e4-bd71-45ef-896c-7a34ac701eec', '541f216d-0797-4065-8398-8864e14cfe22', '752389ab-67a9-4b20-a383-4907e4de799b'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:13 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" returned: 0 in 0.514s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 2G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:13 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 2G Apr 08 15:54:13 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:13 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:13 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (fb5e626b-ca80-4e5c-a530-e965f4c0c946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:14 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb71e80c-7279-48c6-a8d3-e744b3a2ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb71e80c-7279-48c6-a8d3-e744b3a2ba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50702299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b70e57c-ed46-4f75-b239-c896869ce997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:14Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1832af52-984b-4a68-b4f0-8fb6a98ebc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1832af52-984b-4a68-b4f0-8fb6a98ebc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9aca4e-1b99-4b90-a9bd-5394830b08b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9aca4e-1b99-4b90-a9bd-5394830b08b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b70e57c-ed46-4f75-b239-c896869ce997', 'volume_name': 'volume-5b70e57c-ed46-4f75-b239-c896869ce997', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a3bebb-3cd0-4c67-afd4-504844722c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a3bebb-3cd0-4c67-afd4-504844722c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a01bec-2086-42fe-8a5f-c29fc10b4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume 5b70e57c-ed46-4f75-b239-c896869ce997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b70e57c-ed46-4f75-b239-c896869ce997', 'volume_size': 1} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.483s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-64cb651b-4162-4f7f-8537-b05eba0fd369 tempest-GroupsV314Test-2111889307 None] Delete group completed successfully. Apr 08 15:54:14 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 2G" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:14 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 Apr 08 15:54:14 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (fe9b5905-08ef-46cd-bd1e-1fc4c7e6aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21522b3e-815c-4dd9-abc8-04a83ac9ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21522b3e-815c-4dd9-abc8-04a83ac9ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679499445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406bb444-8bb9-4c4b-9113-a94390a76047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e7a0c9-1857-4201-a770-d169d95ce01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e7a0c9-1857-4201-a770-d169d95ce01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9d76b2-232c-43a2-8520-993bc567fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9d76b2-232c-43a2-8520-993bc567fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406bb444-8bb9-4c4b-9113-a94390a76047', 'volume_name': 'volume-406bb444-8bb9-4c4b-9113-a94390a76047', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d1ee56-939e-4881-b0f4-1509d4e536da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d1ee56-939e-4881-b0f4-1509d4e536da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3bca9-d3ff-4ac4-9336-01b7a45b9f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume 406bb444-8bb9-4c4b-9113-a94390a76047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406bb444-8bb9-4c4b-9113-a94390a76047', 'volume_size': 1} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (9e852641-fbbd-49bf-a411-a9b214fc4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2efdd4-e3fb-4afc-b107-2da829b5b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2efdd4-e3fb-4afc-b107-2da829b5b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533124636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72f9531-4c1f-45fd-836c-9e05e892aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ca26cc-7b12-49c7-a958-2ca12e4a85cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ca26cc-7b12-49c7-a958-2ca12e4a85cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c4c63-59ce-439c-a2f2-f3644b188286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c4c63-59ce-439c-a2f2-f3644b188286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72f9531-4c1f-45fd-836c-9e05e892aa59', 'volume_name': 'volume-c72f9531-4c1f-45fd-836c-9e05e892aa59', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893283e-d38f-4479-85a4-a8179e310b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893283e-d38f-4479-85a4-a8179e310b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151a25e5-d82a-4ce5-8433-32971f45b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:14 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume c72f9531-4c1f-45fd-836c-9e05e892aa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72f9531-4c1f-45fd-836c-9e05e892aa59', 'volume_size': 1} Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:14 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13" returned: 0 in 0.457s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:14 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 is being set with open permissions: ugo+rw Apr 08 15:54:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:14 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 Apr 08 15:54:14 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (e5ba18df-ffdb-44e5-927a-bfbfeb19621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e4d63c-45e0-4143-b32a-c87d787ce7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e4d63c-45e0-4143-b32a-c87d787ce7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307579903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317b15a7-e35d-40a1-8b24-63fb82506d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f84a5e4-a8d2-48d9-8b10-1b3753e74b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f84a5e4-a8d2-48d9-8b10-1b3753e74b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12258189-8cb8-46c4-a43d-6f8293d36240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12258189-8cb8-46c4-a43d-6f8293d36240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317b15a7-e35d-40a1-8b24-63fb82506d9d', 'volume_name': 'volume-317b15a7-e35d-40a1-8b24-63fb82506d9d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129d31e7-3f2a-4677-93e2-6f0a4098a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129d31e7-3f2a-4677-93e2-6f0a4098a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220d0810-b2bd-4d33-94eb-f6262837a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume 317b15a7-e35d-40a1-8b24-63fb82506d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317b15a7-e35d-40a1-8b24-63fb82506d9d', 'volume_size': 1} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (c340acd3-91d7-4111-b2e1-9ce97ce9b504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394cc56d-022c-4d18-b0e6-09eacda1c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394cc56d-022c-4d18-b0e6-09eacda1c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336154735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37d6295-03f3-4eba-a3d6-0d214d4282a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ffb742-5363-47fa-b5a2-2765b8e91749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ffb742-5363-47fa-b5a2-2765b8e91749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fd4d91-0ced-4a72-a824-6c94ba98a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fd4d91-0ced-4a72-a824-6c94ba98a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37d6295-03f3-4eba-a3d6-0d214d4282a8', 'volume_name': 'volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7b4a05-4f04-4336-95ac-b45c99e7eff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7b4a05-4f04-4336-95ac-b45c99e7eff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee200f-765a-43cd-8cc0-94d5051ac084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:15 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume c37d6295-03f3-4eba-a3d6-0d214d4282a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8', 'volume_size': 1} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:15 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13" returned: 0 in 0.518s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:15 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info Apr 08 15:54:15 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:15 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info" returned: 0 in 0.483s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:15 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info is being set with open permissions: ugo+rw Apr 08 15:54:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:16 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info Apr 08 15:54:16 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:16 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.info" returned: 0 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.861s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating offline snapshot 09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 of volume be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:54:16 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a31b13a4-1855-42e6-8cca-9e76170970a6 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Create snapshot completed successfully Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29193b9f-3248-4bfd-a28a-cafa026be113]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:16 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 Apr 08 15:54:16 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:17 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:17 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 1G Apr 08 15:54:17 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "cinder-df5aaa5c-ebb9-4833-b340-17900b505a13-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-df5aaa5c-ebb9-4833-b340-17900b505a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "cinder-quobyte-df5aaa5c-ebb9-4833-b340-17900b505a13" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-df5aaa5c-ebb9-4833-b340-17900b505a13" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Deleting offline snapshot df5aaa5c-ebb9-4833-b340-17900b505a13 of volume 5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] snapshot_file for this snap is: volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbad2d1-5516-4712-876d-facea1eeb30b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:17 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 Apr 08 15:54:17 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:17 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 1G" returned: 0 in 0.587s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be590303-2b68-499b-ac2a-5163c2e41a02 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:17 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be590303-2b68-499b-ac2a-5163c2e41a02 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 Apr 08 15:54:17 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:17 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13" returned: 0 in 0.561s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087ed13-d37d-4abb-a8c0-f448192360c0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:17 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 Apr 08 15:54:17 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:18 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be590303-2b68-499b-ac2a-5163c2e41a02 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:18 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 is being set with open permissions: ugo+rw Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:18 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 Apr 08 15:54:18 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c926eb6e-74dc-49a3-a7f2-9cb7b279e884 tempest-GroupsV320Test-63907517 None] Group tempest-GroupsV320Test-Group-1392987627: creating Apr 08 15:54:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c926eb6e-74dc-49a3-a7f2-9cb7b279e884 tempest-GroupsV320Test-63907517 None] Group tempest-GroupsV320Test-Group-1392987627: created successfully Apr 08 15:54:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c926eb6e-74dc-49a3-a7f2-9cb7b279e884 tempest-GroupsV320Test-63907517 None] Create group completed successfully. Apr 08 15:54:18 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:18 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 Apr 08 15:54:18 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:18 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:18 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info Apr 08 15:54:18 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:18 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:18 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13 Apr 08 15:54:18 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:19 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info" returned: 0 in 0.432s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:19 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info is being set with open permissions: ugo+rw Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:19 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info Apr 08 15:54:19 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:19 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20.df5aaa5c-ebb9-4833-b340-17900b505a13" returned: 0 in 0.415s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-df5aaa5c-ebb9-4833-b340-17900b505a13" released by "_delete_snapshot" :: held 2.020s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" released by "delete_snapshot" :: held 2.033s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Created reservations ['fdc812b0-7c42-4be3-a2f7-eb50ba7adef1', 'e2f08a5e-0ee9-4d8f-8f74-8d2d74e4ac41', '4022898f-9b61-4a75-a755-1679a96915f2', '62358aa9-d247-4161-b867-dd9437321dfc'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Delete snapshot completed successfully. Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbc90209-206c-4534-a0df-943b0e8ffa1d tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-df5aaa5c-ebb9-4833-b340-17900b505a13-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:19 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.info" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.027s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50702299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b70e57c-ed46-4f75-b239-c896869ce997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:14Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume 5b70e57c-ed46-4f75-b239-c896869ce997 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:19 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:19 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 1073741824 Apr 08 15:54:19 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3a143528-e1ae-484d-a8fa-139715b5298a tempest-CreateVolumesFromSnapshotTest-2020697064 None] Create snapshot completed successfully Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Created reservations ['1e7a97b1-1b3a-41dd-bbf2-caf72c4f0b8f'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:19 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:19 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:20 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (f55facd4-4373-432d-80aa-072c17857a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e550ba2f-10ca-4ecf-8797-39cc3331f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 1073741824" returned: 0 in 0.614s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:20 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.495s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e550ba2f-10ca-4ecf-8797-39cc3331f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103728120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb254eb-a1ad-4721-b593-ff9d03beb44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87ef368-dec8-4d10-a81e-5caa15efc9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87ef368-dec8-4d10-a81e-5caa15efc9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790619e-feff-48df-b306-b1c9e58abc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790619e-feff-48df-b306-b1c9e58abc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb254eb-a1ad-4721-b593-ff9d03beb44c', 'volume_name': 'volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec147d-67c8-4391-8fcd-f6d3d7a5a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec147d-67c8-4391-8fcd-f6d3d7a5a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c27cf9c-0411-4884-9fc8-474159c0c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume bcb254eb-a1ad-4721-b593-ff9d03beb44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c', 'volume_size': 1} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-25cd7333-021d-48f1-8cd3-7bc545f1fe66 tempest-GroupsV320Test-63907517 None] Delete group completed successfully. Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:20 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 Apr 08 15:54:20 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (15800cb4-5466-4d8b-adad-4c7c5355399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f735038-2523-4663-9ea4-731c40d1f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f735038-2523-4663-9ea4-731c40d1f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182663587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e7e0b-ad11-44c8-b46e-f5159e07f47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4045ba-0141-4e35-a2af-2b4603aa5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4045ba-0141-4e35-a2af-2b4603aa5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb70ee-5c50-4fd2-ae26-539c24d857ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb70ee-5c50-4fd2-ae26-539c24d857ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28e7e0b-ad11-44c8-b46e-f5159e07f47c', 'volume_name': 'volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5b6554-ea64-4a6e-8638-4cf2c7d1ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5b6554-ea64-4a6e-8638-4cf2c7d1ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac03fc-d0c4-4e05-bfe8-00958d6ac45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume b28e7e0b-ad11-44c8-b46e-f5159e07f47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c', 'volume_size': 1} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "cinder-5a95f88d-a935-4c2c-b8c0-839a28c8ec20-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (60151420-877f-4dd7-9d31-bd1716e0a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c1b4d-cc48-424c-9045-2fbe5a4d7c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-5a95f88d-a935-4c2c-b8c0-839a28c8ec20-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c1b4d-cc48-424c-9045-2fbe5a4d7c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355366208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e812ac-0df5-4523-90ac-4edeb494686a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6508cd49-4d2f-471c-ae5c-298f180c98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6508cd49-4d2f-471c-ae5c-298f180c98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbd7c94-8175-44cb-8250-493623811249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbd7c94-8175-44cb-8250-493623811249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e812ac-0df5-4523-90ac-4edeb494686a', 'volume_name': 'volume-07e812ac-0df5-4523-90ac-4edeb494686a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4956f9a-7c35-4b8b-9bea-0c2f54e4ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4956f9a-7c35-4b8b-9bea-0c2f54e4ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02b5eae-1dc1-4e85-8a44-2caa6099ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume 07e812ac-0df5-4523-90ac-4edeb494686a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e812ac-0df5-4523-90ac-4edeb494686a', 'volume_size': 1} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b62d6-d96c-4d8e-8d6d-26188a9377e7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:20 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 Apr 08 15:54:20 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:20 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997" returned: 0 in 0.508s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679499445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406bb444-8bb9-4c4b-9113-a94390a76047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume 406bb444-8bb9-4c4b-9113-a94390a76047 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a01bec-2086-42fe-8a5f-c29fc10b4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b70e57c-ed46-4f75-b239-c896869ce997', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 1073741824 Apr 08 15:54:20 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4427e-ab45-4681-8dee-08b04921f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-5b70e57c-ed46-4f75-b239-c896869ce997 (5b70e57c-ed46-4f75-b239-c896869ce997): created successfully Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4427e-ab45-4681-8dee-08b04921f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (fb5e626b-ca80-4e5c-a530-e965f4c0c946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (5b436ab0-d654-4e55-8b13-f2ce5a1254da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e960d-95e8-4a6e-9596-c576374caaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9beb37ca-7bff-47a0-b4b1-a2fc8a5f3210 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e960d-95e8-4a6e-9596-c576374caaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1426887093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4106a7eb-56b3-40bc-8b28-c286e95c386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:21Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed98ebc-b30b-4d5b-b7dd-283a3515045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed98ebc-b30b-4d5b-b7dd-283a3515045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f3861-623e-4da5-ad6b-1d0571d8abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f3861-623e-4da5-ad6b-1d0571d8abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4106a7eb-56b3-40bc-8b28-c286e95c386d', 'volume_name': 'volume-4106a7eb-56b3-40bc-8b28-c286e95c386d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51e373-0b6a-432c-9550-3932d122320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51e373-0b6a-432c-9550-3932d122320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d4433d-f1c6-4dca-867e-f5df0c2dcb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume 4106a7eb-56b3-40bc-8b28-c286e95c386d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4106a7eb-56b3-40bc-8b28-c286e95c386d', 'volume_size': 1} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (5bb34d95-1898-4221-bb45-4c4b8f791dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9746af6-c0ad-4625-b79d-edf4fb989a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9746af6-c0ad-4625-b79d-edf4fb989a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509306099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e3a16e-fb6f-4b06-9acd-bcca0d1ed576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:21Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89d5aa0-59f2-4f87-99ce-500fa1468c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89d5aa0-59f2-4f87-99ce-500fa1468c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92a78e0-9885-4269-bf29-4b0c289c8788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92a78e0-9885-4269-bf29-4b0c289c8788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e3a16e-fb6f-4b06-9acd-bcca0d1ed576', 'volume_name': 'volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4f7676-56c8-4769-ab89-e1834b138a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4f7676-56c8-4769-ab89-e1834b138a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80b3eaf-864c-4bfb-b851-75c901b90d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume 04e3a16e-fb6f-4b06-9acd-bcca0d1ed576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576', 'volume_size': 1} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:21 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 1073741824" returned: 0 in 0.593s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:21 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" returned: 0 in 0.739s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:21 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20 Apr 08 15:54:21 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:21 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 Apr 08 15:54:21 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:21 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:21 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:21 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.952s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533124636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72f9531-4c1f-45fd-836c-9e05e892aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume c72f9531-4c1f-45fd-836c-9e05e892aa59 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:21 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3bca9-d3ff-4ac4-9336-01b7a45b9f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406bb444-8bb9-4c4b-9113-a94390a76047', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f32d74-5f25-47f9-b921-f4ad16f25769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" returned: 0 in 0.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:21 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 1073741824 Apr 08 15:54:21 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-quobyte-5a95f88d-a935-4c2c-b8c0-839a28c8ec20" released by "delete_volume" :: held 1.341s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-406bb444-8bb9-4c4b-9113-a94390a76047 (406bb444-8bb9-4c4b-9113-a94390a76047): created successfully Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f32d74-5f25-47f9-b921-f4ad16f25769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (fe9b5905-08ef-46cd-bd1e-1fc4c7e6aee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c1fcdde3-3b63-4db9-9312-bc776ed164ce tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:21 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Created reservations ['def1694c-a674-45ad-af17-ad9a51021506', 'c8ba8294-53b2-49c1-8eaf-2e22f832e52b', '096008aa-0f4b-4bcc-b81c-6819d490fbdb', '4b861652-1194-4d7c-94f8-fce5a25399ee'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:22 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:22 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:22 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.557s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:22 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 1073741824" returned: 0 in 0.648s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:22 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 Apr 08 15:54:22 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:22 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.558s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Deleted volume successfully. Apr 08 15:54:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-043e5003-b9d6-43fa-8036-477b6fa7c8d9 tempest-VolumesSnapshotNegativeTestJSON-1716822723 None] Lock "cinder-5a95f88d-a935-4c2c-b8c0-839a28c8ec20-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:23 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59" returned: 0 in 0.496s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.915s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307579903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317b15a7-e35d-40a1-8b24-63fb82506d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume 317b15a7-e35d-40a1-8b24-63fb82506d9d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:23 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151a25e5-d82a-4ce5-8433-32971f45b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72f9531-4c1f-45fd-836c-9e05e892aa59', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:23 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d 1073741824 Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a2bc91-842f-4888-a75b-ac3b66d77294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:23 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:23 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 (c72f9531-4c1f-45fd-836c-9e05e892aa59): created successfully Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a2bc91-842f-4888-a75b-ac3b66d77294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (9e852641-fbbd-49bf-a411-a9b214fc4041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2b8343d6-0c5a-4b62-a799-cbc727d066b6 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:23 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d 1073741824" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:23 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d Apr 08 15:54:23 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:24 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d" returned: 0 in 0.508s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.825s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336154735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37d6295-03f3-4eba-a3d6-0d214d4282a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d8131843154028bd652b9d48beb7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:15Z,use_quota=True,user_id='4218820b1fb84603a090830eed3b12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Creating volume c37d6295-03f3-4eba-a3d6-0d214d4282a8 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:24 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:24 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 1073741824 Apr 08 15:54:24 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220d0810-b2bd-4d33-94eb-f6262837a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317b15a7-e35d-40a1-8b24-63fb82506d9d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848b98f0-89ff-4c7c-a2a8-1483f2c6d858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-317b15a7-e35d-40a1-8b24-63fb82506d9d (317b15a7-e35d-40a1-8b24-63fb82506d9d): created successfully Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848b98f0-89ff-4c7c-a2a8-1483f2c6d858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (e5ba18df-ffdb-44e5-927a-bfbfeb19621f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-69111dc8-4573-472b-a634-468c3740f050 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (8a32cbff-2eb1-4494-a826-07a034ea1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64290e46-3ea9-408e-81ae-6c53b579dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64290e46-3ea9-408e-81ae-6c53b579dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-430926883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410114f2-9936-4789-bd02-fb4c47a9933a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:25Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cfffde-bae2-4c0f-af67-2752440047cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cfffde-bae2-4c0f-af67-2752440047cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f849ed-a3ef-45cc-b5c6-559382776c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f849ed-a3ef-45cc-b5c6-559382776c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410114f2-9936-4789-bd02-fb4c47a9933a', 'volume_name': 'volume-410114f2-9936-4789-bd02-fb4c47a9933a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84f07d-daf1-467d-880c-95d62edf12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84f07d-daf1-467d-880c-95d62edf12af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a70612-d52a-4a10-8007-0d170aaa144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:24 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Volume 410114f2-9936-4789-bd02-fb4c47a9933a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410114f2-9936-4789-bd02-fb4c47a9933a', 'volume_size': 1} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:24 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 1073741824" returned: 0 in 0.558s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:24 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 Apr 08 15:54:24 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:25 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8" returned: 0 in 0.425s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.998s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103728120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb254eb-a1ad-4721-b593-ff9d03beb44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume bcb254eb-a1ad-4721-b593-ff9d03beb44c {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:25 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee200f-765a-43cd-8cc0-94d5051ac084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac7b0a-a6f7-4afd-8a73-df1d821cb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:25 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c 1073741824 Apr 08 15:54:25 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Volume volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 (c37d6295-03f3-4eba-a3d6-0d214d4282a8): created successfully Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac7b0a-a6f7-4afd-8a73-df1d821cb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Flow 'volume_create_manager' (c340acd3-91d7-4111-b2e1-9ce97ce9b504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-86e90507-de45-403e-9c2d-9ed3c424306d tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created volume successfully. Apr 08 15:54:25 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c 1073741824" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:25 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c Apr 08 15:54:25 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-c37d6295-03f3-4eba-a3d6-0d214d4282a8-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-c37d6295-03f3-4eba-a3d6-0d214d4282a8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-c37d6295-03f3-4eba-a3d6-0d214d4282a8" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-c37d6295-03f3-4eba-a3d6-0d214d4282a8" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[034714b4-6068-4401-af56-7604e41b92da]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:26 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 Apr 08 15:54:26 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:26 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.954s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182663587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28e7e0b-ad11-44c8-b46e-f5159e07f47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume b28e7e0b-ad11-44c8-b46e-f5159e07f47c {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c27cf9c-0411-4884-9fc8-474159c0c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:26 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c 1073741824 Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dee180-57dd-41dc-b831-c0d7fa24c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:26 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c (bcb254eb-a1ad-4721-b593-ff9d03beb44c): created successfully Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dee180-57dd-41dc-b831-c0d7fa24c754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (f55facd4-4373-432d-80aa-072c17857a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0567fd2b-9dc0-4176-bb36-cb1a77d4cb81 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:26 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8" returned: 0 in 0.537s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:26 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8 Apr 08 15:54:26 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:26 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c 1073741824" returned: 0 in 0.629s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:26 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c Apr 08 15:54:26 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:27 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c37d6295-03f3-4eba-a3d6-0d214d4282a8" returned: 0 in 0.530s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-c37d6295-03f3-4eba-a3d6-0d214d4282a8" released by "delete_volume" :: held 1.095s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['188a186b-3620-4572-a956-624bb0dcf94f', '99ad1052-ddd9-43d0-a848-dfedf5cef120', '01530e21-26ce-48d1-ace9-077036c8b165', 'dfddb5ce-9608-40d3-83d4-018d12e9f916'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:27 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:27 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:27 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.877s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355366208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e812ac-0df5-4523-90ac-4edeb494686a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:20Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume 07e812ac-0df5-4523-90ac-4edeb494686a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:27 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:27 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a 1073741824 Apr 08 15:54:27 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac03fc-d0c4-4e05-bfe8-00958d6ac45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5afb5f-b0b6-4032-b6d2-4dbf42d97403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c (b28e7e0b-ad11-44c8-b46e-f5159e07f47c): created successfully Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5afb5f-b0b6-4032-b6d2-4dbf42d97403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (15800cb4-5466-4d8b-adad-4c7c5355399a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-32af842f-e180-4d5b-9298-329f61a5aab9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:27 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.423s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-faa4ee02-c7b4-4d9d-8327-d17c921d0622 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-c37d6295-03f3-4eba-a3d6-0d214d4282a8-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:27 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a 1073741824" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:27 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a Apr 08 15:54:27 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-317b15a7-e35d-40a1-8b24-63fb82506d9d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-317b15a7-e35d-40a1-8b24-63fb82506d9d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-317b15a7-e35d-40a1-8b24-63fb82506d9d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-317b15a7-e35d-40a1-8b24-63fb82506d9d" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[525ebae4-8640-4cd0-8d25-7bd8db410e96]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:28 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d Apr 08 15:54:28 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:28 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.551s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1426887093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4106a7eb-56b3-40bc-8b28-c286e95c386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:21Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume 4106a7eb-56b3-40bc-8b28-c286e95c386d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:28 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02b5eae-1dc1-4e85-8a44-2caa6099ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e812ac-0df5-4523-90ac-4edeb494686a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:28 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d 1073741824 Apr 08 15:54:28 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c966f-cb82-4196-aa47-0b4cff4000e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:28 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-07e812ac-0df5-4523-90ac-4edeb494686a (07e812ac-0df5-4523-90ac-4edeb494686a): created successfully Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c966f-cb82-4196-aa47-0b4cff4000e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (60151420-877f-4dd7-9d31-bd1716e0a360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f7ac2710-9865-4648-b670-a6d7eeefd9f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:28 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d" returned: 0 in 0.548s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:28 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d Apr 08 15:54:28 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:29 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d 1073741824" returned: 0 in 0.543s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:29 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d Apr 08 15:54:29 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:29 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-317b15a7-e35d-40a1-8b24-63fb82506d9d" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-317b15a7-e35d-40a1-8b24-63fb82506d9d" released by "delete_volume" :: held 1.060s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['1d6187b5-ed28-49f5-aa21-bd06ddb1600d', 'e54a0f66-5992-45e5-8c84-8aeb988a2670', 'a75d3da5-4c33-418f-9f4c-f95152fe91e9', '922d5b90-f27f-4f13-8980-f84e149e055c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:29 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:29 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:29 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d" returned: 0 in 0.468s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.454s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509306099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e3a16e-fb6f-4b06-9acd-bcca0d1ed576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81354162a7274446b1e77742354c597e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:21Z,use_quota=True,user_id='6ad22f67cbbb48ee96f00aebe49a8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Creating volume 04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:29 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d4433d-f1c6-4dca-867e-f5df0c2dcb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4106a7eb-56b3-40bc-8b28-c286e95c386d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3ab84a-f87e-4988-bde1-ee33ae103c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:29 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 1073741824 Apr 08 15:54:29 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:29 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-4106a7eb-56b3-40bc-8b28-c286e95c386d (4106a7eb-56b3-40bc-8b28-c286e95c386d): created successfully Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3ab84a-f87e-4988-bde1-ee33ae103c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (5b436ab0-d654-4e55-8b13-f2ce5a1254da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6f255ed1-f491-449b-b385-56ead843ac93 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:29 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.532s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6dd6f27d-d5fe-4eda-8014-0669865cbdb1 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-317b15a7-e35d-40a1-8b24-63fb82506d9d-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:30 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 1073741824" returned: 0 in 0.582s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:30 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 Apr 08 15:54:30 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-c72f9531-4c1f-45fd-836c-9e05e892aa59-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-c72f9531-4c1f-45fd-836c-9e05e892aa59-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-c72f9531-4c1f-45fd-836c-9e05e892aa59" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-c72f9531-4c1f-45fd-836c-9e05e892aa59" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169826a-9364-4f07-9a40-c95516ed5187]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:30 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:30 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.920s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:30 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-430926883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410114f2-9936-4789-bd02-fb4c47a9933a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:25Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Creating volume 410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:30 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80b3eaf-864c-4bfb-b851-75c901b90d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1c45fa-8ad0-4cff-8874-ebf859eb7d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Volume volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 (04e3a16e-fb6f-4b06-9acd-bcca0d1ed576): created successfully Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1c45fa-8ad0-4cff-8874-ebf859eb7d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:30 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a 1073741824 Apr 08 15:54:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Flow 'volume_create_manager' (5bb34d95-1898-4221-bb45-4c4b8f791dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:30 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:30 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f8f3baac-c85b-4bcd-b61b-7e8af2d8daa1 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created volume successfully. Apr 08 15:54:31 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59" returned: 0 in 0.523s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:31 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59 Apr 08 15:54:31 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:31 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a 1073741824" returned: 0 in 0.637s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:31 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:31 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:31 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-c72f9531-4c1f-45fd-836c-9e05e892aa59" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-c72f9531-4c1f-45fd-836c-9e05e892aa59" released by "delete_volume" :: held 1.010s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['2767f4df-171f-4077-abeb-40b619019ecd', '08b7775a-940c-4322-81b6-9812610d6cd0', 'b8f7933c-e4fa-4f0c-bef9-2d6d127187d7', 'ecf03724-4f97-43a1-8d8d-54d6d9c109be'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:31 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:31 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:31 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a70612-d52a-4a10-8007-0d170aaa144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410114f2-9936-4789-bd02-fb4c47a9933a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05ef6e-94d6-4cf8-a16d-ab03c8bc6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Volume volume-410114f2-9936-4789-bd02-fb4c47a9933a (410114f2-9936-4789-bd02-fb4c47a9933a): created successfully Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05ef6e-94d6-4cf8-a16d-ab03c8bc6301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (8a32cbff-2eb1-4494-a826-07a034ea1671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-14980fe4-24cd-45a0-aae5-acb326eb4694 tempest-VolumeDependencyTests-1944617175 None] Created volume successfully. Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[525bbc57-5c3b-4421-9da9-653975bde572]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:32 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 Apr 08 15:54:32 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:32 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.491s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:32 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca584809-9b4c-432e-a8e6-ad1dc85d4859 tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-c72f9531-4c1f-45fd-836c-9e05e892aa59-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Creating offline snapshot 5e5cf830-b3ab-4cf4-b026-17d6b7dda67d of volume 410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ee868-ba08-4f2f-aa08-20afd14182e9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:32 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:32 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:32 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" returned: 0 in 0.573s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:32 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576 Apr 08 15:54:32 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-406bb444-8bb9-4c4b-9113-a94390a76047-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-406bb444-8bb9-4c4b-9113-a94390a76047-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-406bb444-8bb9-4c4b-9113-a94390a76047" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-406bb444-8bb9-4c4b-9113-a94390a76047" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5e349-7e5c-450f-928c-fef09d5d4a2d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:32 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:32 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 Apr 08 15:54:32 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:32 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d 1G Apr 08 15:54:32 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:32 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" returned: 0 in 0.507s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576" released by "delete_volume" :: held 1.115s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['d0fd610f-acde-4724-a6d2-99fa0898dd2a', 'ca504054-d37e-4e44-b1eb-5d478e9e54b2', 'd097fac8-2383-409e-afa2-e2be27e4ad87', 'a0c30b01-f6fd-491a-bfc4-f4699da1c10b'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:33 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:33 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:33 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047" returned: 0 in 0.638s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:33 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047 Apr 08 15:54:33 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:33 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d 1G" returned: 0 in 0.616s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410114f2-9936-4789-bd02-fb4c47a9933a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:33 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410114f2-9936-4789-bd02-fb4c47a9933a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:33 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:33 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.522s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-636be07b-e79f-4856-aa05-5e491244bf4f tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-04e3a16e-fb6f-4b06-9acd-bcca0d1ed576-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:33 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-406bb444-8bb9-4c4b-9113-a94390a76047" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-406bb444-8bb9-4c4b-9113-a94390a76047" released by "delete_volume" :: held 1.124s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['b58742cf-2d30-46ea-91f1-99d04d3da6ed', 'c691e1ca-7699-4f3b-b343-7972b31b9130', '465792e2-a69c-49a6-b420-37e8d9368296', '91444504-c737-489a-873f-ed1077b4f2a9'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:33 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:33 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:33 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410114f2-9936-4789-bd02-fb4c47a9933a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.570s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:33 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d is being set with open permissions: ugo+rw Apr 08 15:54:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:34 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:34 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-4106a7eb-56b3-40bc-8b28-c286e95c386d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-4106a7eb-56b3-40bc-8b28-c286e95c386d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-4106a7eb-56b3-40bc-8b28-c286e95c386d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-4106a7eb-56b3-40bc-8b28-c286e95c386d" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc3469a-1a92-4bfa-9c8a-19c554d1b2a3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:34 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d Apr 08 15:54:34 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:34 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4dc1f212-8a77-4f11-aca6-cbe70f73e92a tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-406bb444-8bb9-4c4b-9113-a94390a76047-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:34 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:34 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info Apr 08 15:54:34 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:34 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d" returned: 0 in 0.536s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:34 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d Apr 08 15:54:34 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-5b70e57c-ed46-4f75-b239-c896869ce997-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-5b70e57c-ed46-4f75-b239-c896869ce997-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-5b70e57c-ed46-4f75-b239-c896869ce997" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-5b70e57c-ed46-4f75-b239-c896869ce997" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922a8dc-61b9-41a1-ae22-19037584cab9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:35 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info" returned: 0 in 0.530s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:35 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info is being set with open permissions: ugo+rw Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:35 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 Apr 08 15:54:35 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info Apr 08 15:54:35 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:35 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:35 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-4106a7eb-56b3-40bc-8b28-c286e95c386d" returned: 0 in 0.557s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-4106a7eb-56b3-40bc-8b28-c286e95c386d" released by "delete_volume" :: held 1.123s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['3cdb8a5e-c80e-483a-814d-4efb294735ab', '3d44e9a1-f1d5-4fa3-8afe-687dd1e97169', '0c178af8-aed4-4c42-8d28-2f5935483c62', '2c3bcb9f-3045-4595-91e9-5e2099da08a6'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:35 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:35 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:35 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997" returned: 0 in 0.649s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:35 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.info" returned: 0 in 0.589s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:35 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997 Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.475s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:35 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-dd08fc98-d98a-4947-a829-6d04f323f157 tempest-VolumeDependencyTests-1944617175 None] Create snapshot completed successfully Apr 08 15:54:35 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.524s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-71e4ccf6-73f4-4783-bcdc-8e17d1faf4f9 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-4106a7eb-56b3-40bc-8b28-c286e95c386d-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:36 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5b70e57c-ed46-4f75-b239-c896869ce997" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-5b70e57c-ed46-4f75-b239-c896869ce997" released by "delete_volume" :: held 1.152s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['265ac286-5e49-42f4-8ab1-8e02c0182df0', '4f7be29b-502f-4c43-92a3-30433e49d1cb', 'a1ad2cbf-3dd6-4cf3-8c45-c44586418bd2', 'a769e010-6d56-494a-8eb2-6adb18ad0575'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:36 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:36 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-07e812ac-0df5-4523-90ac-4edeb494686a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-07e812ac-0df5-4523-90ac-4edeb494686a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-07e812ac-0df5-4523-90ac-4edeb494686a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-07e812ac-0df5-4523-90ac-4edeb494686a" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1988767a-6f7d-41b5-b6d8-da5afbca4b75]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:36 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a Apr 08 15:54:36 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (a7ab3bb5-a86f-4c77-8db9-5511f089fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fefab6-95b2-44f4-a616-6d2233373461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fefab6-95b2-44f4-a616-6d2233373461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2101089790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515db45a-27bc-44e6-abd8-b19bc6e18c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e5cf830-b3ab-4cf4-b026-17d6b7dda67d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:37Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c792e-a975-4922-92e2-9fffbd5bc9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c792e-a975-4922-92e2-9fffbd5bc9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4b2ae6-4d21-4dad-9700-4c4abf3a04b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4b2ae6-4d21-4dad-9700-4c4abf3a04b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '515db45a-27bc-44e6-abd8-b19bc6e18c79', 'volume_name': 'volume-515db45a-27bc-44e6-abd8-b19bc6e18c79', 'volume_size': 1, 'snapshot_id': '5e5cf830-b3ab-4cf4-b026-17d6b7dda67d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b6896-8db2-4f9f-8afd-779400a85e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b6896-8db2-4f9f-8afd-779400a85e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a257c69-2bf2-484f-8478-58dec0ac579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:36 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Volume 515db45a-27bc-44e6-abd8-b19bc6e18c79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-515db45a-27bc-44e6-abd8-b19bc6e18c79', 'volume_size': 1, 'snapshot_id': '5e5cf830-b3ab-4cf4-b026-17d6b7dda67d'} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-515db45a-27bc-44e6-abd8-b19bc6e18c79" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-515db45a-27bc-44e6-abd8-b19bc6e18c79" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Creating volume 515db45a-27bc-44e6-abd8-b19bc6e18c79 from snapshot 5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:36 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.637s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] snapshot: 5e5cf830-b3ab-4cf4-b026-17d6b7dda67d, volume: 515db45a-27bc-44e6-abd8-b19bc6e18c79, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:54:36 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a" returned: 0 in 0.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5bcf3-d74d-4578-9137-666bac2f6881]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:36 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a Apr 08 15:54:36 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-fef2ef25-2ef1-48d8-ad95-01a3141fde6c tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-5b70e57c-ed46-4f75-b239-c896869ce997-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:36 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:36 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-7b2111f4-88c7-42d6-986f-349ca0380838-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-7b2111f4-88c7-42d6-986f-349ca0380838-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "cinder-quobyte-7b2111f4-88c7-42d6-986f-349ca0380838" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-7b2111f4-88c7-42d6-986f-349ca0380838" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd6fcc8-4d12-4507-ac87-81c2f09dcbbb]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:37 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 Apr 08 15:54:37 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:37 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-07e812ac-0df5-4523-90ac-4edeb494686a" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-07e812ac-0df5-4523-90ac-4edeb494686a" released by "delete_volume" :: held 1.127s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['08558af7-2419-4789-b0ff-b3f440c510ab', 'a8fde794-da0f-4204-85fd-7251c8722f2e', 'ccf5ca4e-87a1-4353-9b7f-5ea79a7cdaa9', '347a428a-06e6-47cd-ae61-3f6a90dd3f02'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:37 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.595s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-410114f2-9936-4789-bd02-fb4c47a9933a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60af8500-c561-4e8b-963a-a68e33f13179]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:37 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:37 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:37 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:37 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:37 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838" returned: 0 in 0.633s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:37 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838 Apr 08 15:54:37 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:38 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.511s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:38 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-af37925c-5eaa-41c3-b961-2c2557c69856 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-07e812ac-0df5-4523-90ac-4edeb494686a-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:38 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.561s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:38 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 Apr 08 15:54:38 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-b28e7e0b-ad11-44c8-b46e-f5159e07f47c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-b28e7e0b-ad11-44c8-b46e-f5159e07f47c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:38 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7b2111f4-88c7-42d6-986f-349ca0380838" returned: 0 in 0.622s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-quobyte-7b2111f4-88c7-42d6-986f-349ca0380838" released by "delete_volume" :: held 1.295s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9176f7-eae6-4805-b240-aa53c6139402]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Created reservations ['164f2176-5ba1-4255-b7ac-17962a90cb64', '90db88ba-3f6e-4d79-8488-bd1d8f29883b', 'f1ab8dc2-2a83-41c0-9684-f1cd1ebb656b', '2c40babe-25af-4fc3-8c0b-bc09684867e1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:38 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c Apr 08 15:54:38 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:38 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:38 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:39 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" returned: 0 in 1.184s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:39 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c Apr 08 15:54:39 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:39 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.323s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:39 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Deleted volume successfully. Apr 08 15:54:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1402a288-0d97-481d-ba97-3f15374346db tempest-CreateVolumesFromSourceVolumeTest-743120062 None] Lock "cinder-7b2111f4-88c7-42d6-986f-349ca0380838-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:40 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79" returned: 0 in 2.859s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:40 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fed75d-777e-4e48-9082-fb34f24e7b2e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:41 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:41 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:41 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" returned: 0 in 1.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-b28e7e0b-ad11-44c8-b46e-f5159e07f47c" released by "delete_volume" :: held 2.724s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['e4d737bb-4567-4663-8138-c93bcafe11bd', '85cd4a1f-9ae6-46a3-9653-d2b0fe3b7652', '32aa9967-5847-471d-8a1c-2bd897e33175', '0baf56c3-6787-467e-92a6-80939268ec61'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:41 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:41 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:41 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.810s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a, size 1024.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:54:41 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Converted 1024.00 MB image at 357.98 MB/s Apr 08 15:54:41 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 is being set with open permissions: ugo+rw Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:41 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 Apr 08 15:54:41 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:41 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.547s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a3bb4942-7b23-4a13-9c52-ab2810b94f56 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-b28e7e0b-ad11-44c8-b46e-f5159e07f47c-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-bcb254eb-a1ad-4721-b593-ff9d03beb44c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-bcb254eb-a1ad-4721-b593-ff9d03beb44c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-bcb254eb-a1ad-4721-b593-ff9d03beb44c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-bcb254eb-a1ad-4721-b593-ff9d03beb44c" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79182484-ed75-44df-b96b-2f64c114bb74]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:42 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c Apr 08 15:54:42 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:42 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79" returned: 0 in 0.528s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" released by "_copy_volume_from_snapshot" :: held 5.437s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-515db45a-27bc-44e6-abd8-b19bc6e18c79" released by "_create_volume_from_snapshot" :: held 5.470s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.485s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a257c69-2bf2-484f-8478-58dec0ac579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515db45a-27bc-44e6-abd8-b19bc6e18c79', 'volume_size': 1, 'snapshot_id': '5e5cf830-b3ab-4cf4-b026-17d6b7dda67d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44760b1c-0636-45c4-b192-d8e58b0d71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:42 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Volume volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 (515db45a-27bc-44e6-abd8-b19bc6e18c79): created successfully Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44760b1c-0636-45c4-b192-d8e58b0d71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (a7ab3bb5-a86f-4c77-8db9-5511f089fe80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2f5a9859-ea2e-4a3a-b38b-3e9097f84ee7 tempest-VolumeDependencyTests-1944617175 None] Created volume successfully. Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Deleting offline snapshot 5e5cf830-b3ab-4cf4-b026-17d6b7dda67d of volume 410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] snapshot_file for this snap is: volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16904463-ff88-478e-89b2-90c3fb5e1c29]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:42 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c" returned: 0 in 0.608s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:42 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c Apr 08 15:54:42 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:42 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:42 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:43 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bcb254eb-a1ad-4721-b593-ff9d03beb44c" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-bcb254eb-a1ad-4721-b593-ff9d03beb44c" released by "delete_volume" :: held 1.136s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['f97cff4a-8959-4811-8849-a2abff9d6db3', '72b96542-ef20-4154-87ca-63f5fdc52f47', '20f3dca2-2b93-4d1f-9837-dd8c19b4920d', 'cfb0d8f1-696a-48e6-9298-33939a3863f8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:43 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.549s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-410114f2-9936-4789-bd02-fb4c47a9933a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e84bc-dd36-4ea4-8aaf-945e73ee782b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:43 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:43 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:43 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:43 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:43 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.533s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:43 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b3b099a8-3b5a-451c-831e-ebdea0a14d76 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-bcb254eb-a1ad-4721-b593-ff9d03beb44c-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:43 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:43 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleting offline snapshot 09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 of volume be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] snapshot_file for this snap is: volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b0aca-78ad-41ce-986e-21b64ecf5e5c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:44 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 Apr 08 15:54:44 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:44 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.585s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:44 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d Apr 08 15:54:44 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:44 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" returned: 0 in 0.543s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be590303-2b68-499b-ac2a-5163c2e41a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0ca63-eb35-40b2-8adc-7d3ff45133e2]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:44 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a.5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d" released by "_delete_snapshot" :: held 2.214s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" released by "delete_snapshot" :: held 2.231s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:44 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 Apr 08 15:54:44 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Created reservations ['434f1416-624b-4f5c-bc68-252100a84d8b', '150dc81d-8530-485b-93bd-276c72a80b07', 'dfef8aec-fd2a-45fd-bd99-1ab9d2963c34', 'e166cf67-c9ea-4ced-8b08-701b112eb8b5'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Delete snapshot completed successfully. Apr 08 15:54:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dcec5db-fcbe-4755-a6e8-625fa854b676 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-5e5cf830-b3ab-4cf4-b026-17d6b7dda67d-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:45 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02" returned: 0 in 0.537s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:45 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 Apr 08 15:54:45 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:45 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" returned: 0 in 0.459s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-410114f2-9936-4789-bd02-fb4c47a9933a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:45 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736 Apr 08 15:54:45 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-410114f2-9936-4789-bd02-fb4c47a9933a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3d7a3-3838-4235-9a1b-50406ea9b657]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:45 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:45 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:46 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02.09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" returned: 0 in 0.449s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736" released by "_delete_snapshot" :: held 2.074s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" released by "delete_snapshot" :: held 2.089s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['8e794d8c-a131-4f5d-880f-b28f52b77baf', '15b56d47-fdb4-4e02-a774-30f6ad16ed46', '878c3f14-7dfc-4147-a617-6cd4f93681b4', 'b7a0e48b-8088-4d2e-81bb-c5be73e5a731'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:46 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Delete snapshot completed successfully. Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-50c412bb-b8e6-4ec9-9391-3cb588334a01 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-09c4cfe7-9405-4eb4-b6a8-fd2fbf257736-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:46 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.538s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:46 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a Apr 08 15:54:46 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:46 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-410114f2-9936-4789-bd02-fb4c47a9933a" returned: 0 in 0.427s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-410114f2-9936-4789-bd02-fb4c47a9933a" released by "delete_volume" :: held 1.019s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Created reservations ['3418ae0b-3e03-4e80-8008-579aa3f8d1ec', '27ce4559-f95a-4899-8a96-f3e212e62f26', 'b3f4276b-a0af-478d-b767-d790f782ccaf', '4371f5ac-d6f8-42ca-8143-67e6874dbc14'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:46 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:46 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-be590303-2b68-499b-ac2a-5163c2e41a02-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-be590303-2b68-499b-ac2a-5163c2e41a02-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae94f3-1f3f-459e-92f5-5646037e44f4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:47 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.491s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:47 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Deleted volume successfully. Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c1cb938d-22b4-4ab7-bfe8-2c2178e4052a tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-410114f2-9936-4789-bd02-fb4c47a9933a-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:47 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 Apr 08 15:54:47 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:47 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:47 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02 Apr 08 15:54:47 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (1a7a2bf3-355f-4992-8821-4dffa82ccacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5219c2d3-532b-4102-b164-b5f4af64c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5219c2d3-532b-4102-b164-b5f4af64c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583426022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6c3be-8cd7-4874-887a-7e849b73d6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:48Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a81182-fb4f-4722-9d09-5bf7360c1ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a81182-fb4f-4722-9d09-5bf7360c1ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce281636-66ee-448a-b6e1-051f01e8014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce281636-66ee-448a-b6e1-051f01e8014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'volume_name': 'volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fca51-f0be-40de-b838-d9811999f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fca51-f0be-40de-b838-d9811999f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d490573-cc38-4056-889d-9d689a97e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Volume 05b6c3be-8cd7-4874-887a-7e849b73d6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'volume_size': 1} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583426022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6c3be-8cd7-4874-887a-7e849b73d6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:48Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Creating volume 05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:54:48 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:48 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 1073741824 Apr 08 15:54:48 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:48 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be590303-2b68-499b-ac2a-5163c2e41a02" returned: 0 in 0.641s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-quobyte-be590303-2b68-499b-ac2a-5163c2e41a02" released by "delete_volume" :: held 1.211s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Created reservations ['c4af324d-4eb8-463a-b72b-46ae22a4d1f7', '020f2bea-f802-448b-84d3-07fefcc026c8', 'e1dc6250-0df1-4a6b-b214-07b160c59427', 'd01a2710-2d0d-4718-8462-5d5636940abb'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:48 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:54:48 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:48 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 1073741824" returned: 0 in 0.585s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:48 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:54:48 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:49 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:54:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Deleted volume successfully. Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e1d09869-9961-409e-8d93-b1324c5123f3 tempest-CreateVolumesFromSnapshotTest-2020697064 None] Lock "cinder-be590303-2b68-499b-ac2a-5163c2e41a02-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:49 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.519s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d490573-cc38-4056-889d-9d689a97e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60dbbc4-b458-414b-b1f3-9cc56352f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:49 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Volume volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 (05b6c3be-8cd7-4874-887a-7e849b73d6f9): created successfully Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60dbbc4-b458-414b-b1f3-9cc56352f386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:49 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (1a7a2bf3-355f-4992-8821-4dffa82ccacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:49 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e0875135-e2ad-4247-ae4c-2b83bc3127e3 tempest-VolumeDependencyTests-1944617175 None] Created volume successfully. Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (fee00dfa-dc5e-4f50-b72d-964d503b35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767553a-aa62-4ac7-910b-1eb4d478d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5767553a-aa62-4ac7-910b-1eb4d478d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1924979118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231d7063-d6df-414d-a686-471eadfda016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146700c7d0c4a5886c560229497e066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=05b6c3be-8cd7-4874-887a-7e849b73d6f9,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:51Z,use_quota=True,user_id='daf02fbf7c9d41849ae298ff9a94e026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b538867a-2843-4825-a9b8-b819d63962dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b538867a-2843-4825-a9b8-b819d63962dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7cd2af-15c4-4f7b-bba9-8b3794bced9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7cd2af-15c4-4f7b-bba9-8b3794bced9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '231d7063-d6df-414d-a686-471eadfda016', 'volume_name': 'volume-231d7063-d6df-414d-a686-471eadfda016', 'volume_size': 1, 'source_volid': '05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a0aeaa-b24e-4a02-b5de-ef73ec87a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a0aeaa-b24e-4a02-b5de-ef73ec87a90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb36f151-053e-4c45-bd69-cc7464557fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:50 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Volume 231d7063-d6df-414d-a686-471eadfda016: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-231d7063-d6df-414d-a686-471eadfda016', 'volume_size': 1, 'source_volid': '05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'source_volstatus': 'available'} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:50 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Cloning volume 05b6c3be-8cd7-4874-887a-7e849b73d6f9 to volume 231d7063-d6df-414d-a686-471eadfda016 Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Creating offline snapshot 4e31c7f0-9542-4d16-b626-3925dce41bfb of volume 05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1803d1-1de3-42ec-a03e-20c323ff916f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:51 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:54:51 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Flow 'volume_create_manager' (9b4d209c-57ae-471b-a6b2-aff57998502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9538847-fea0-4053-b52b-ca36a39fc6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9538847-fea0-4053-b52b-ca36a39fc6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7f3a33-3728-437d-a6cc-8585454a8b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39faaf33610042429aebf8381d4ac780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:51Z,use_quota=True,user_id='dc5a70a1b72241a694241e901d8ef875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d91b565-c4b1-4429-8737-ac1d0b556bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d91b565-c4b1-4429-8737-ac1d0b556bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef18c4ed-88b4-4b07-a0a6-f07b938bddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef18c4ed-88b4-4b07-a0a6-f07b938bddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7f3a33-3728-437d-a6cc-8585454a8b97', 'volume_name': 'volume-bc7f3a33-3728-437d-a6cc-8585454a8b97', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66943092-2b9e-4211-a7ca-b5ca8daf5765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66943092-2b9e-4211-a7ca-b5ca8daf5765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17824f9-d304-4225-8e72-5bce48d47193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:54:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Volume bc7f3a33-3728-437d-a6cc-8585454a8b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7f3a33-3728-437d-a6cc-8585454a8b97', 'volume_size': 1} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:51 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.625s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:51 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb 1G Apr 08 15:54:51 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:52 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb 1G" returned: 0 in 0.601s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:52 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:54:52 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:52 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:52 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb is being set with open permissions: ugo+rw Apr 08 15:54:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:52 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:54:52 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:53 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.545s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:53 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info Apr 08 15:54:53 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:53 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info" returned: 0 in 0.475s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:53 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info is being set with open permissions: ugo+rw Apr 08 15:54:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:53 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info Apr 08 15:54:53 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:54 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.info" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] snapshot: 4e31c7f0-9542-4d16-b626-3925dce41bfb, volume: 231d7063-d6df-414d-a686-471eadfda016, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[00756bd7-f0fe-42f8-bf7a-730a98b07d2c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:54 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:54:54 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:54 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.547s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e8245-8cef-4142-9fd6-82c52e2ff068]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:54 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:54:54 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:55 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.497s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:55 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:54:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:55 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 Apr 08 15:54:55 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:57 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016" returned: 0 in 2.101s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:57 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5105db-412f-4e8b-94a0-a110c7d758ef]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:57 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:54:57 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:58 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.621s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:54:58 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Converted 1024.00 MB image at 487.17 MB/s Apr 08 15:54:58 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 is being set with open permissions: ugo+rw Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:58 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 Apr 08 15:54:58 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:58 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016" returned: 0 in 0.399s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" released by "_copy_volume_from_snapshot" :: held 4.229s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-4e31c7f0-9542-4d16-b626-3925dce41bfb" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-4e31c7f0-9542-4d16-b626-3925dce41bfb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Deleting offline snapshot 4e31c7f0-9542-4d16-b626-3925dce41bfb of volume 05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] snapshot_file for this snap is: volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a26257-7e76-439d-bb22-7e50e3307c20]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:58 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:54:58 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:59 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.585s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af6bda-30ca-46ed-87f5-54f88b3c3785]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:59 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:54:59 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:54:59 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.565s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:54:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:54:59 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:54:59 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:00 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.548s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:00 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb Apr 08 15:55:00 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:00 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9.4e31c7f0-9542-4d16-b626-3925dce41bfb" returned: 0 in 0.460s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-4e31c7f0-9542-4d16-b626-3925dce41bfb" released by "_delete_snapshot" :: held 2.238s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.815s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.178s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7f3a33-3728-437d-a6cc-8585454a8b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39faaf33610042429aebf8381d4ac780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:54:51Z,use_quota=True,user_id='dc5a70a1b72241a694241e901d8ef875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Creating volume bc7f3a33-3728-437d-a6cc-8585454a8b97 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:00 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb36f151-053e-4c45-bd69-cc7464557fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231d7063-d6df-414d-a686-471eadfda016', 'volume_size': 1, 'source_volid': '05b6c3be-8cd7-4874-887a-7e849b73d6f9', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aef982-6bab-41a0-b6e0-ce5b69b8b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:00 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 1073741824 Apr 08 15:55:00 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:00 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Volume volume-231d7063-d6df-414d-a686-471eadfda016 (231d7063-d6df-414d-a686-471eadfda016): created successfully Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aef982-6bab-41a0-b6e0-ce5b69b8b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Flow 'volume_create_manager' (fee00dfa-dc5e-4f50-b72d-964d503b35c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0dff638a-2b47-46da-bb6e-3aa1ad0ee1c9 tempest-VolumeDependencyTests-1944617175 None] Created volume successfully. Apr 08 15:55:01 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 1073741824" returned: 0 in 0.516s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:01 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 Apr 08 15:55:01 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-05b6c3be-8cd7-4874-887a-7e849b73d6f9-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-05b6c3be-8cd7-4874-887a-7e849b73d6f9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-05b6c3be-8cd7-4874-887a-7e849b73d6f9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-05b6c3be-8cd7-4874-887a-7e849b73d6f9" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae002ed7-a0ce-4922-9d3f-13d13416c1f8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:01 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:55:01 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:01 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97" returned: 0 in 0.460s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17824f9-d304-4225-8e72-5bce48d47193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7f3a33-3728-437d-a6cc-8585454a8b97', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4188f87-ae72-4334-8b6e-9a7a9558df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:01 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Volume volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 (bc7f3a33-3728-437d-a6cc-8585454a8b97): created successfully Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4188f87-ae72-4334-8b6e-9a7a9558df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:01 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Flow 'volume_create_manager' (9b4d209c-57ae-471b-a6b2-aff57998502c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-860fe172-35e8-429d-ae75-daa403ec0eac tempest-CinderUnicodeTest-32549550 None] Created volume successfully. Apr 08 15:55:02 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.527s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:02 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9 Apr 08 15:55:02 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Flow 'volume_create_manager' (71adb924-2981-4056-9e97-48939b0ddccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7c614f-65cc-4b23-bd0f-7cf9ba5afaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7c614f-65cc-4b23-bd0f-7cf9ba5afaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-957621502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208a0cf4-3c32-4ced-97ef-a051a6171dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39faaf33610042429aebf8381d4ac780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:02Z,use_quota=True,user_id='dc5a70a1b72241a694241e901d8ef875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dcb0b0-4321-41bd-b74a-531199d568ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dcb0b0-4321-41bd-b74a-531199d568ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7028b4-0971-419a-9f59-b8878c066091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7028b4-0971-419a-9f59-b8878c066091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208a0cf4-3c32-4ced-97ef-a051a6171dfb', 'volume_name': 'volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf15e1-4a95-4b8f-81f4-4d002a76b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf15e1-4a95-4b8f-81f4-4d002a76b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898699be-cdb8-4bae-8bdb-5505b7bc74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Volume 208a0cf4-3c32-4ced-97ef-a051a6171dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb', 'volume_size': 1} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-957621502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208a0cf4-3c32-4ced-97ef-a051a6171dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39faaf33610042429aebf8381d4ac780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:02Z,use_quota=True,user_id='dc5a70a1b72241a694241e901d8ef875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Creating volume 208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:02 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:02 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb 1073741824 Apr 08 15:55:02 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:02 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-05b6c3be-8cd7-4874-887a-7e849b73d6f9" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-05b6c3be-8cd7-4874-887a-7e849b73d6f9" released by "delete_volume" :: held 1.029s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Created reservations ['4207dfc6-48e0-4cc1-a7a6-ff341fdef41a', '2be0e2a1-d24f-4241-b638-7b1eb4f7db32', 'd1fb837f-6b0c-4fb9-9f25-cfb1374302f7', '4a151a58-c847-464c-b279-15461e353c3a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:02 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:02 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:02 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb 1073741824" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:UPDATE=226,cinder:SELECT=185,cinder:INSERT=59,cinder:DELETE=14 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:55:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:03 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb Apr 08 15:55:03 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:03 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.419s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:03 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Deleted volume successfully. Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-dc058cb1-b45f-411e-95f9-a470b4cef915 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-05b6c3be-8cd7-4874-887a-7e849b73d6f9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:03 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb" returned: 0 in 0.432s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=196,cinder:INSERT=64,cinder:UPDATE=289,cinder:DELETE=25 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898699be-cdb8-4bae-8bdb-5505b7bc74c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91261bfb-9489-4f98-b0d5-49e81192d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Volume volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb (208a0cf4-3c32-4ced-97ef-a051a6171dfb): created successfully Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91261bfb-9489-4f98-b0d5-49e81192d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Flow 'volume_create_manager' (71adb924-2981-4056-9e97-48939b0ddccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:03 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-914ec1ac-cf3e-47f6-b8d5-ed90a61d11ab tempest-CinderUnicodeTest-32549550 None] Created volume successfully. Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-231d7063-d6df-414d-a686-471eadfda016-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-231d7063-d6df-414d-a686-471eadfda016-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37bff8a-4da6-42de-bd9a-d77597bdfa17]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:03 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 Apr 08 15:55:03 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:04 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016" returned: 0 in 0.468s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:04 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016 Apr 08 15:55:04 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:04 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-231d7063-d6df-414d-a686-471eadfda016" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-231d7063-d6df-414d-a686-471eadfda016" released by "delete_volume" :: held 0.944s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Creating offline snapshot 0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f of volume 208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4896f5-8644-42ac-b67c-7f0a59001a10]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Created reservations ['8ac8ef34-1037-4555-b38e-c2b5ece5e6a6', '31dbd77e-f841-477c-a78d-4d680953f36c', 'c168e0be-be89-4b1f-8e56-77069e7cc3d3', '7af4c889-1955-47bf-bb5f-f1ccceb1e221'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:04 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb Apr 08 15:55:04 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:04 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:04 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:05 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb" returned: 0 in 0.596s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:05 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f 1G Apr 08 15:55:05 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:05 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.577s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Deleted volume successfully. Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-69f2b28e-a7d6-4c96-8244-b3a1873e9152 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-231d7063-d6df-414d-a686-471eadfda016-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:05 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-515db45a-27bc-44e6-abd8-b19bc6e18c79-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f 1G" returned: 0 in 0.607s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:05 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f Apr 08 15:55:05 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-515db45a-27bc-44e6-abd8-b19bc6e18c79-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb664812-00b7-4278-a7f1-3d127202e1f8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:06 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 Apr 08 15:55:06 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:06 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:06 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f is being set with open permissions: ugo+rw Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:06 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f Apr 08 15:55:06 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:06 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79" returned: 0 in 0.579s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:06 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79 Apr 08 15:55:06 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:06 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" returned: 0 in 0.459s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:06 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info Apr 08 15:55:06 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:07 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-515db45a-27bc-44e6-abd8-b19bc6e18c79" returned: 0 in 0.507s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-quobyte-515db45a-27bc-44e6-abd8-b19bc6e18c79" released by "delete_volume" :: held 1.117s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Created reservations ['3166cb44-e2e4-4db9-9982-417e33d8dc44', '6727fd48-90af-4da0-bde5-059d0daddc9e', 'cd1e7236-fc53-465c-baca-b90a3bc9a555', 'eb72e1ae-d686-4109-aeda-6c395c6b77e1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:07 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:07 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (35e37991-e597-45d3-aceb-d5e71f6c42a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca17504-f7f0-43e5-8a3f-26ef79778e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:07 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info" returned: 0 in 0.590s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:07 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info is being set with open permissions: ugo+rw Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca17504-f7f0-43e5-8a3f-26ef79778e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602392526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f152c6a-881f-4416-98a8-76af8cef358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:07Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcd6e26-e3a6-417a-a7aa-e7df05a16e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:07 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info Apr 08 15:55:07 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcd6e26-e3a6-417a-a7aa-e7df05a16e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb71fef0-a19c-4f3f-80db-71c9f659b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb71fef0-a19c-4f3f-80db-71c9f659b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f152c6a-881f-4416-98a8-76af8cef358f', 'volume_name': 'volume-6f152c6a-881f-4416-98a8-76af8cef358f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b2890-5e8a-4d9c-8abf-77db3384fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b2890-5e8a-4d9c-8abf-77db3384fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882e3e6-78c5-40de-998c-1976edb139f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Volume 6f152c6a-881f-4416-98a8-76af8cef358f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f152c6a-881f-4416-98a8-76af8cef358f', 'volume_size': 1} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:07 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.526s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Deleted volume successfully. Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8e7cedbd-8dae-409a-a386-e7afdda8c605 tempest-VolumeDependencyTests-1944617175 None] Lock "cinder-515db45a-27bc-44e6-abd8-b19bc6e18c79-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:07 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.info" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602392526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f152c6a-881f-4416-98a8-76af8cef358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:07Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Creating volume 6f152c6a-881f-4416-98a8-76af8cef358f {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:07 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:08 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f 1073741824 Apr 08 15:55:08 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d4a0655c-aa05-4173-adb5-ac07115faccd tempest-CinderUnicodeTest-32549550 None] Create snapshot completed successfully Apr 08 15:55:08 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f 1073741824" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:08 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f Apr 08 15:55:08 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-quobyte-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Deleting offline snapshot 0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f of volume 208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] snapshot_file for this snap is: volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[731ff88a-d8d9-40de-8dee-bcd87f7e8cf0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:09 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f Apr 08 15:55:09 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:09 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882e3e6-78c5-40de-998c-1976edb139f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f152c6a-881f-4416-98a8-76af8cef358f', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d168de36-d740-40d5-9b92-3dcfd0877ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:09 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Volume volume-6f152c6a-881f-4416-98a8-76af8cef358f (6f152c6a-881f-4416-98a8-76af8cef358f): created successfully Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d168de36-d740-40d5-9b92-3dcfd0877ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (35e37991-e597-45d3-aceb-d5e71f6c42a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e7bdbf11-546f-4709-ab83-0a095d13b0ca tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:09 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" returned: 0 in 0.573s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e5ac9-f8fb-44e2-a429-0f72d3c7012a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:09 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb Apr 08 15:55:09 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d038cc6b-2786-4297-ab49-27efceb2c711 tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f" by "attach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d038cc6b-2786-4297-ab49-27efceb2c711 tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f" acquired by "attach_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d038cc6b-2786-4297-ab49-27efceb2c711 tempest-VolumesActionsTest-110919227 None] Attaching volume 6f152c6a-881f-4416-98a8-76af8cef358f to instance 721ef227-f4df-4a22-9ef3-6842fbbfffdd at mountpoint /dev/vdb on host None. Apr 08 15:55:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d038cc6b-2786-4297-ab49-27efceb2c711 tempest-VolumesActionsTest-110919227 None] Attach volume completed successfully. Apr 08 15:55:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d038cc6b-2786-4297-ab49-27efceb2c711 tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f" released by "attach_volume" :: held 0.094s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:10 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:10 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f Apr 08 15:55:10 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:10 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" returned: 0 in 0.482s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:10 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f Apr 08 15:55:10 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Terminate volume connection completed successfully. Apr 08 15:55:10 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb.0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" returned: 0 in 0.421s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f" released by "_delete_snapshot" :: held 2.030s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" released by "delete_snapshot" :: held 2.040s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:10 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Created reservations ['9123cb9b-dbc1-48d6-95ac-ea65eebfae77', 'ce54cb47-9759-468f-91b3-f47a038f1a8d', '0ef1da1f-d2d6-429a-82af-ac41113f590a', '22d54ce8-fc39-4a1c-b35d-afadb0dece45'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Delete snapshot completed successfully. Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7adb8b92-010d-406e-9a03-afdd0c1e1142 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-0f2b125a-1c1e-4d1d-ad7d-ea5152222c3f-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" by "detach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Detaching volume 6f152c6a-881f-4416-98a8-76af8cef358f from instance 721ef227-f4df-4a22-9ef3-6842fbbfffdd. Apr 08 15:55:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Detach volume completed successfully. Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-016cc2d3-f638-4d9a-b2bb-81b65cbf12f2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8c750f47-d040-4c10-88f8-4d25b88eadfe tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" by "detach_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8c750f47-d040-4c10-88f8-4d25b88eadfe tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8c750f47-d040-4c10-88f8-4d25b88eadfe tempest-VolumesActionsTest-110919227 None] Volume detach called, but volume not attached. Apr 08 15:55:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8c750f47-d040-4c10-88f8-4d25b88eadfe tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-208a0cf4-3c32-4ced-97ef-a051a6171dfb-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "cinder-208a0cf4-3c32-4ced-97ef-a051a6171dfb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b36811-8b55-4aed-9618-cf53ca574d2e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:12 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb Apr 08 15:55:12 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-quobyte-6f152c6a-881f-4416-98a8-76af8cef358f" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "cinder-quobyte-6f152c6a-881f-4416-98a8-76af8cef358f" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5525e0b9-05c2-4f24-b6ca-805354d88d14]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:12 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f Apr 08 15:55:12 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:12 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb" returned: 0 in 0.492s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:12 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb Apr 08 15:55:12 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:12 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f" returned: 0 in 0.475s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:12 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f Apr 08 15:55:12 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:13 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-208a0cf4-3c32-4ced-97ef-a051a6171dfb" returned: 0 in 0.426s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-208a0cf4-3c32-4ced-97ef-a051a6171dfb" released by "delete_volume" :: held 0.953s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Created reservations ['7cc75f65-351c-45a3-a5b2-0bfd150059f4', '6118ab70-34f4-4c18-9c31-5b988dbcfcc6', '8433e83e-949d-4089-aae3-9cb2c1bba060', '855c2e05-6285-4fb0-b8d3-8dd927732ede'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-bc7f3a33-3728-437d-a6cc-8585454a8b97-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:13 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:13 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-bc7f3a33-3728-437d-a6cc-8585454a8b97-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "cinder-quobyte-bc7f3a33-3728-437d-a6cc-8585454a8b97" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-bc7f3a33-3728-437d-a6cc-8585454a8b97" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a65d53-661a-43c3-b9f5-38770faf8c1b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:13 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 Apr 08 15:55:13 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:13 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6f152c6a-881f-4416-98a8-76af8cef358f" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "cinder-quobyte-6f152c6a-881f-4416-98a8-76af8cef358f" released by "delete_volume" :: held 0.954s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Created reservations ['4999c5ed-ef5b-457b-ac21-a75950cd22c0', 'cf11fb7a-bc7e-4774-92ae-9efe975cb2a2', '89b177cf-a890-4d47-a34f-d627a323db42', '048ad382-f551-40a0-943a-309577f461da'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:13 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:13 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:13 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.568s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Deleted volume successfully. Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e8da4231-20b3-4c4d-be41-315566a0346a tempest-CinderUnicodeTest-32549550 None] Lock "cinder-208a0cf4-3c32-4ced-97ef-a051a6171dfb-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:13 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97" returned: 0 in 0.627s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:13 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97 Apr 08 15:55:13 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:13 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Deleted volume successfully. Apr 08 15:55:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5beafda2-0cf3-4ceb-a4d3-1201b7983286 tempest-VolumesActionsTest-110919227 None] Lock "cinder-6f152c6a-881f-4416-98a8-76af8cef358f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:14 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bc7f3a33-3728-437d-a6cc-8585454a8b97" returned: 0 in 0.449s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-quobyte-bc7f3a33-3728-437d-a6cc-8585454a8b97" released by "delete_volume" :: held 1.095s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Created reservations ['f7780283-3f4e-4bdf-93ca-8440b2c3cc23', '2885e869-826b-4505-80c2-16333a65a898', 'a7bbf731-a65d-4bf1-b433-13f56f1ea8b7', '7f92e68b-3a7c-418b-9d8f-742a61c9f97e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:14 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:14 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:14 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.390s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Deleted volume successfully. Apr 08 15:55:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-85f88948-0c1f-4787-bcc9-a95c4dd9e435 tempest-CinderUnicodeTest-32549550 None] Lock "cinder-bc7f3a33-3728-437d-a6cc-8585454a8b97-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (20380059-0b2e-4be2-95ea-82374d83cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea088bb-42e2-4a8b-aca1-5057cbeca168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea088bb-42e2-4a8b-aca1-5057cbeca168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-737856642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db99a53-1680-467c-854a-25136093accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:20Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f585acbf-5160-4766-98f4-db74eb640974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f585acbf-5160-4766-98f4-db74eb640974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae242d87-1578-4162-9c51-461d665a6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae242d87-1578-4162-9c51-461d665a6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db99a53-1680-467c-854a-25136093accf', 'volume_name': 'volume-7db99a53-1680-467c-854a-25136093accf', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cbc651-37c7-47f0-8b08-fad8c1980920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cbc651-37c7-47f0-8b08-fad8c1980920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d052116-0e4f-4e51-9fe3-c4736be41fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Volume 7db99a53-1680-467c-854a-25136093accf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db99a53-1680-467c-854a-25136093accf', 'volume_size': 1} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-737856642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db99a53-1680-467c-854a-25136093accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:20Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Creating volume 7db99a53-1680-467c-854a-25136093accf {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:20 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:20 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf 1073741824 Apr 08 15:55:20 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:20 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf 1073741824" returned: 0 in 0.520s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:20 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf Apr 08 15:55:20 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:21 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf" returned: 0 in 0.430s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d052116-0e4f-4e51-9fe3-c4736be41fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db99a53-1680-467c-854a-25136093accf', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91e360c-9a17-451e-aab7-42175bea2185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Volume volume-7db99a53-1680-467c-854a-25136093accf (7db99a53-1680-467c-854a-25136093accf): created successfully Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91e360c-9a17-451e-aab7-42175bea2185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (20380059-0b2e-4be2-95ea-82374d83cb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7116a7e4-039d-41eb-9a86-67c88d9abda5 tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:21 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:21 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:22 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-7db99a53-1680-467c-854a-25136093accf-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-7db99a53-1680-467c-854a-25136093accf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-quobyte-7db99a53-1680-467c-854a-25136093accf" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-7db99a53-1680-467c-854a-25136093accf" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5737d1-aa96-43cc-9836-0a0a03e9f418]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:22 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf Apr 08 15:55:22 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:22 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf" returned: 0 in 0.537s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:22 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf Apr 08 15:55:22 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:23 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7db99a53-1680-467c-854a-25136093accf" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-7db99a53-1680-467c-854a-25136093accf" released by "delete_volume" :: held 1.025s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Created reservations ['47ea1af5-a055-45eb-8e9f-0f020c1820d7', 'da108f90-02ec-4a7e-98ee-97fafdb916c4', 'c3693227-4f85-4700-8c0c-215de9695835', 'dba43616-a665-4c49-af63-b971f02a3149'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:23 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:23 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:23 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.425s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Deleted volume successfully. Apr 08 15:55:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-eca4008c-571c-4c47-b2a6-1e4e756b4cb2 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-7db99a53-1680-467c-854a-25136093accf-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (6ca5e33d-267f-4fd4-88af-3f74f5419e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375b5ee6-00d5-4fd7-8eb8-8b96959a2d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375b5ee6-00d5-4fd7-8eb8-8b96959a2d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-672867025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:25Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2ba944-0e0e-4894-93d6-4896d3b2d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2ba944-0e0e-4894-93d6-4896d3b2d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e5a396-cfc9-4723-af3e-b5830b25fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e5a396-cfc9-4723-af3e-b5830b25fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c', 'volume_name': 'volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e90721a-876f-4b49-8635-b5390208aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e90721a-876f-4b49-8635-b5390208aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79331bf6-b05f-45fa-aa3e-6aa2f70cc20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:24 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Volume 6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c', 'volume_size': 1} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-672867025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:25Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Creating volume 6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:24 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:24 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c 1073741824 Apr 08 15:55:24 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:25 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c 1073741824" returned: 0 in 0.498s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:25 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c Apr 08 15:55:25 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:25 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79331bf6-b05f-45fa-aa3e-6aa2f70cc20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c0cdd7-cb51-48cf-a32a-b47b081f23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Volume volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c (6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c): created successfully Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c0cdd7-cb51-48cf-a32a-b47b081f23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (6ca5e33d-267f-4fd4-88af-3f74f5419e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7950545a-1b02-4872-893d-f9709b17f280 tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "cinder-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-quobyte-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5980242-4abd-40f8-ba15-d1af1fc8d405]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:27 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c Apr 08 15:55:27 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:27 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" returned: 0 in 0.627s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:27 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c Apr 08 15:55:27 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:28 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c" released by "delete_volume" :: held 1.160s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Created reservations ['a9525877-7bc3-47fc-9c3f-0af97ccf0963', '4949149f-f479-4605-b236-0f7253ba5f5c', '61e4a436-e09d-4305-b976-bb5eceb6b9ed', 'cd70c137-1c61-438b-8c32-b676207dfa39'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:28 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:28 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:28 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.553s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Deleted volume successfully. Apr 08 15:55:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ecedeb1-a3dc-42db-82b1-6b9287f1074f tempest-VolumesActionsTest-1152029387 None] Lock "cinder-6d9cb3cb-fc61-49ef-b0b6-e4902cd7ca0c-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Flow 'volume_create_manager' (242b43bd-0fd9-41fc-b119-d405c7bcd86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f47e25d-147c-4f0e-8253-2f2ff0c45e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f47e25d-147c-4f0e-8253-2f2ff0c45e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1066745953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b41a9142fe3445d9f3a1cb080a5ba9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:29Z,use_quota=True,user_id='61d6f70a56184a91a9403559f73976de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933dc0d3-44dd-4c56-b275-38ba55939443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933dc0d3-44dd-4c56-b275-38ba55939443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882dd8ee-80f6-46c4-9054-922a1c07f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882dd8ee-80f6-46c4-9054-922a1c07f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3', 'volume_name': 'volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507277d2-8d9d-4035-9635-289aac9eb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507277d2-8d9d-4035-9635-289aac9eb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c94fd6a-7042-4534-ad23-c398de3c07a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Volume 3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3', 'volume_size': 1} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1066745953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b41a9142fe3445d9f3a1cb080a5ba9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:29Z,use_quota=True,user_id='61d6f70a56184a91a9403559f73976de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Creating volume 3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:29 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:29 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 1073741824 Apr 08 15:55:29 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (1cc40372-31fc-4381-a1de-60a22d45ca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede7621-a8bd-4e16-84e7-f4932f11cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede7621-a8bd-4e16-84e7-f4932f11cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297244309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be08f99f-0de8-47f8-83e9-a102787cd4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:30Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247604b2-c8d1-417e-bca5-45bcb7b280ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247604b2-c8d1-417e-bca5-45bcb7b280ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70127a5-f5c7-4213-bf68-b5e511c2387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70127a5-f5c7-4213-bf68-b5e511c2387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be08f99f-0de8-47f8-83e9-a102787cd4ae', 'volume_name': 'volume-be08f99f-0de8-47f8-83e9-a102787cd4ae', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0c783-defe-4830-9106-e7ab0fd734f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0c783-defe-4830-9106-e7ab0fd734f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b41a90-d49b-4df7-bc37-bb0a57ce4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:29 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Volume be08f99f-0de8-47f8-83e9-a102787cd4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be08f99f-0de8-47f8-83e9-a102787cd4ae', 'volume_size': 1} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:29 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 1073741824" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:29 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:29 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:30 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.411s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297244309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be08f99f-0de8-47f8-83e9-a102787cd4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:30Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Creating volume be08f99f-0de8-47f8-83e9-a102787cd4ae {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:30 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c94fd6a-7042-4534-ad23-c398de3c07a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a65c5f-8523-4814-b004-974047d88e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:30 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae 1073741824 Apr 08 15:55:30 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Volume volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 (3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3): created successfully Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a65c5f-8523-4814-b004-974047d88e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Flow 'volume_create_manager' (242b43bd-0fd9-41fc-b119-d405c7bcd86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:30 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b133de1e-fd9a-4f18-a86b-7e04f9cdb3d9 tempest-SnapshotDependencyTests-322478983 None] Created volume successfully. Apr 08 15:55:30 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae 1073741824" returned: 0 in 0.478s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:30 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae Apr 08 15:55:30 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:31 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae" returned: 0 in 0.397s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b41a90-d49b-4df7-bc37-bb0a57ce4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be08f99f-0de8-47f8-83e9-a102787cd4ae', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7736e282-7ae2-4e47-863b-91554e3bda56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Volume volume-be08f99f-0de8-47f8-83e9-a102787cd4ae (be08f99f-0de8-47f8-83e9-a102787cd4ae): created successfully Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7736e282-7ae2-4e47-863b-91554e3bda56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (1cc40372-31fc-4381-a1de-60a22d45ca5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d1493943-2b83-4338-8af9-cd9b1fafc978 tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Creating offline snapshot 7dc2f9a8-4a75-42cb-b741-20164a3e042d of volume 3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77aec7-801a-481a-8bef-27e7097b820a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:31 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:31 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-be08f99f-0de8-47f8-83e9-a102787cd4ae-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "cinder-be08f99f-0de8-47f8-83e9-a102787cd4ae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-quobyte-be08f99f-0de8-47f8-83e9-a102787cd4ae" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-be08f99f-0de8-47f8-83e9-a102787cd4ae" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9cc6a7-1869-42b0-a17a-a6f44f438e6b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:31 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:31 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d 1G Apr 08 15:55:31 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:31 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae Apr 08 15:55:31 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:32 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae" returned: 0 in 0.486s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:32 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae Apr 08 15:55:32 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:32 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d 1G" returned: 0 in 0.519s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:32 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:32 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:32 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be08f99f-0de8-47f8-83e9-a102787cd4ae" returned: 0 in 0.402s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-be08f99f-0de8-47f8-83e9-a102787cd4ae" released by "delete_volume" :: held 0.911s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Created reservations ['e3450565-e3e9-4fd9-a9a2-48a793b26736', '5a0af371-af23-498a-99b5-a285de41d760', 'da89f7f2-4c4d-4e8e-ab5a-da072d865f62', '1ce41053-4033-474e-b920-db7f9ec56877'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:32 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:32 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d is being set with open permissions: ugo+rw Apr 08 15:55:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:32 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:32 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:32 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:32 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (03fb7ebc-6e1f-4fb7-ba61-1c547e9c8ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0489296a-fae5-4ebe-9c75-7d44c84519f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0489296a-fae5-4ebe-9c75-7d44c84519f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297620072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ac28da-7706-4aa9-bf96-1357f9ddefb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:33Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a9fae3-7ac7-467d-9203-2492a2137af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a9fae3-7ac7-467d-9203-2492a2137af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029b7c62-29fd-482a-9fe6-13d0e458209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029b7c62-29fd-482a-9fe6-13d0e458209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ac28da-7706-4aa9-bf96-1357f9ddefb9', 'volume_name': 'volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b947b5-609c-4a82-aaad-c81891a420ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b947b5-609c-4a82-aaad-c81891a420ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f490607d-b3b9-46c3-874a-5451e0d51314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:33 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Volume b4ac28da-7706-4aa9-bf96-1357f9ddefb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9', 'volume_size': 1} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:33 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.423s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:33 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Deleted volume successfully. Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c0ca8b6f-e876-4af8-9d4c-85cb6252d5cb tempest-VolumesActionsTest-1152029387 None] Lock "cinder-be08f99f-0de8-47f8-83e9-a102787cd4ae-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:33 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:33 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info Apr 08 15:55:33 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:33 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info" returned: 0 in 0.411s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:33 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info is being set with open permissions: ugo+rw Apr 08 15:55:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:33 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info Apr 08 15:55:33 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:34 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.info" returned: 0 in 0.390s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297620072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ac28da-7706-4aa9-bf96-1357f9ddefb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:33Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Creating volume b4ac28da-7706-4aa9-bf96-1357f9ddefb9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:34 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:34 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 1073741824 Apr 08 15:55:34 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f9410bfa-0241-4a89-bcd9-385e96a36201 tempest-SnapshotDependencyTests-322478983 None] Create snapshot completed successfully Apr 08 15:55:34 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 1073741824" returned: 0 in 0.481s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:34 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 Apr 08 15:55:34 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Flow 'volume_create_manager' (91a271af-304f-4e11-997a-05ca5e7e8623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35884c1-6c69-4a3e-9a18-9e7f51b82e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35884c1-6c69-4a3e-9a18-9e7f51b82e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea509461-0450-4049-b74c-b34f8461f94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b41a9142fe3445d9f3a1cb080a5ba9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dc2f9a8-4a75-42cb-b741-20164a3e042d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:35Z,use_quota=True,user_id='61d6f70a56184a91a9403559f73976de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c888bd41-ffb9-4e2c-bb24-5e5797dda7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c888bd41-ffb9-4e2c-bb24-5e5797dda7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22801681-0009-4a9e-8967-15e274f4d430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22801681-0009-4a9e-8967-15e274f4d430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea509461-0450-4049-b74c-b34f8461f94f', 'volume_name': 'volume-ea509461-0450-4049-b74c-b34f8461f94f', 'volume_size': 1, 'snapshot_id': '7dc2f9a8-4a75-42cb-b741-20164a3e042d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f27927f-ddb0-4aab-8009-0ee1e8f08f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f27927f-ddb0-4aab-8009-0ee1e8f08f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be1a9a2-7f02-45d8-900c-cafd129019fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:34 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Volume ea509461-0450-4049-b74c-b34f8461f94f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea509461-0450-4049-b74c-b34f8461f94f', 'volume_size': 1, 'snapshot_id': '7dc2f9a8-4a75-42cb-b741-20164a3e042d'} Apr 08 15:55:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:35 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" returned: 0 in 0.437s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.202s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d-ea509461-0450-4049-b74c-b34f8461f94f" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f490607d-b3b9-46c3-874a-5451e0d51314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48ed8de-5270-4337-a76a-287e7f07b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d-ea509461-0450-4049-b74c-b34f8461f94f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Creating volume ea509461-0450-4049-b74c-b34f8461f94f from snapshot 7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:35 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Volume volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 (b4ac28da-7706-4aa9-bf96-1357f9ddefb9): created successfully Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48ed8de-5270-4337-a76a-287e7f07b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (03fb7ebc-6e1f-4fb7-ba61-1c547e9c8ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8a2323a2-294a-417b-b8f5-cbb8e7bf59f9 tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] snapshot: 7dc2f9a8-4a75-42cb-b741-20164a3e042d, volume: ea509461-0450-4049-b74c-b34f8461f94f, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1547b87-02ea-4cd9-9134-18b88602e7ff]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:35 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:35 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-b4ac28da-7706-4aa9-bf96-1357f9ddefb9-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-b4ac28da-7706-4aa9-bf96-1357f9ddefb9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "cinder-quobyte-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b42d9-9414-43be-a427-bcff38064ad3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:35 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 Apr 08 15:55:35 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:35 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.544s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb77bf-4316-46eb-b8ae-6b27ecd5a875]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:35 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:35 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:35 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" returned: 0 in 0.487s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:36 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9 Apr 08 15:55:36 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:36 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.457s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:36 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f Apr 08 15:55:36 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:36 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" returned: 0 in 0.424s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-quobyte-b4ac28da-7706-4aa9-bf96-1357f9ddefb9" released by "delete_volume" :: held 0.932s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Created reservations ['542e29fa-7034-4060-8dd4-0bc6b032604a', '577bede0-9259-4fdc-b8de-90216eb8b7cc', 'fbf7d402-617c-4962-8804-a6f91daf2e7b', '5cfa54f8-82eb-464e-80a3-d13dc83b2238'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:36 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:36 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (a4697179-e593-4341-ac10-82aacd43c47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dbc8b9-383f-4e3f-b2c6-6b631af41944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dbc8b9-383f-4e3f-b2c6-6b631af41944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768656159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9b3178-94bf-4a2a-bdaf-4f6473c6662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:37Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bf2bf4-8680-4917-8028-87e1ebafdb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bf2bf4-8680-4917-8028-87e1ebafdb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fe30f6-f575-4109-bba4-f8545890a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fe30f6-f575-4109-bba4-f8545890a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9b3178-94bf-4a2a-bdaf-4f6473c6662e', 'volume_name': 'volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9b037b-c3d2-44ee-9f5e-058ec6f75cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9b037b-c3d2-44ee-9f5e-058ec6f75cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7929fba-6204-4485-b5d2-3d8451342c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:37 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Volume be9b3178-94bf-4a2a-bdaf-4f6473c6662e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e', 'volume_size': 1} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:37 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.028s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:37 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Deleted volume successfully. Apr 08 15:55:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1dff0149-5af3-41a3-8925-25abaa1f5595 tempest-VolumesActionsTest-1152029387 None] Lock "cinder-b4ac28da-7706-4aa9-bf96-1357f9ddefb9-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:38 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f" returned: 0 in 2.107s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b2a96-c30f-4528-ab34-e5d10149bd9b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:38 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:38 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:38 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.629s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:55:38 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Converted 1024.00 MB image at 485.78 MB/s Apr 08 15:55:38 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f is being set with open permissions: ugo+rw Apr 08 15:55:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:39 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f Apr 08 15:55:39 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:39 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" released by "_copy_volume_from_snapshot" :: held 4.210s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d-ea509461-0450-4049-b74c-b34f8461f94f" released by "_create_volume_from_snapshot" :: held 4.246s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.265s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768656159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9b3178-94bf-4a2a-bdaf-4f6473c6662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd260b15922341ec9c1cd7d915b59a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:37Z,use_quota=True,user_id='af7efb76ff0741a5966a8bbd30d26209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Creating volume be9b3178-94bf-4a2a-bdaf-4f6473c6662e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:39 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:39 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e 1073741824 Apr 08 15:55:39 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be1a9a2-7f02-45d8-900c-cafd129019fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea509461-0450-4049-b74c-b34f8461f94f', 'volume_size': 1, 'snapshot_id': '7dc2f9a8-4a75-42cb-b741-20164a3e042d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4f04a4-d26c-4049-a4ca-7d71e27ad5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:39 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Volume volume-ea509461-0450-4049-b74c-b34f8461f94f (ea509461-0450-4049-b74c-b34f8461f94f): created successfully Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4f04a4-d26c-4049-a4ca-7d71e27ad5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Flow 'volume_create_manager' (91a271af-304f-4e11-997a-05ca5e7e8623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2dd905ee-87e4-423c-af5b-d3e492604454 tempest-SnapshotDependencyTests-322478983 None] Created volume successfully. Apr 08 15:55:39 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e 1073741824" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:39 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e Apr 08 15:55:39 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:40 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" returned: 0 in 0.403s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7929fba-6204-4485-b5d2-3d8451342c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38156c3-3e1f-42a3-8126-12d17237693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:40 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Volume volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e (be9b3178-94bf-4a2a-bdaf-4f6473c6662e): created successfully Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38156c3-3e1f-42a3-8126-12d17237693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Flow 'volume_create_manager' (a4697179-e593-4341-ac10-82aacd43c47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:40 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6f44144f-6557-4ee3-b501-3ce7524de916 tempest-VolumesActionsTest-110919227 None] Created volume successfully. Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-7dc2f9a8-4a75-42cb-b741-20164a3e042d-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-7dc2f9a8-4a75-42cb-b741-20164a3e042d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Deleting offline snapshot 7dc2f9a8-4a75-42cb-b741-20164a3e042d of volume 3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] snapshot_file for this snap is: volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2afc75-24cf-4d65-b7a4-cb2730dad5dc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:40 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:40 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:40 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f8e11-9671-4650-876c-e0963d0ba8d6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:40 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:40 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:41 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:41 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:41 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:41 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.459s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:41 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d Apr 08 15:55:41 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-be9b3178-94bf-4a2a-bdaf-4f6473c6662e-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "cinder-be9b3178-94bf-4a2a-bdaf-4f6473c6662e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Acquiring lock "cinder-quobyte-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "cinder-quobyte-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" acquired by "delete_volume" :: waited 0.006s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47203ca1-ffab-4ed5-b90b-96a671bc70b5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:42 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e Apr 08 15:55:42 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:42 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3.7dc2f9a8-4a75-42cb-b741-20164a3e042d" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-7dc2f9a8-4a75-42cb-b741-20164a3e042d" released by "_delete_snapshot" :: held 1.818s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" released by "delete_snapshot" :: held 1.831s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Created reservations ['01171dbe-7af7-410f-8ce1-1e575ffbf22b', '04d43d09-353c-4f93-91a9-fc69101c3f14', 'eaeeb046-f419-4572-a3b6-1fe376b75b71', '202d7abe-3470-448d-a996-d2f41d3ae258'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Delete snapshot completed successfully. Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4beac96a-371d-4595-8552-7a010c3b85a6 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-7dc2f9a8-4a75-42cb-b741-20164a3e042d-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:42 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:42 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e Apr 08 15:55:42 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7921d-2c6e-49b4-8cba-49d7a8c247cf]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:42 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:42 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:42 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "cinder-quobyte-be9b3178-94bf-4a2a-bdaf-4f6473c6662e" released by "delete_volume" :: held 0.890s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Created reservations ['7e091be0-ee1e-48ba-a17a-2013e6dfd4c3', '54174541-f588-4827-8be8-ec5291d446d4', 'bcad3cdb-2c94-4401-a469-054b66017d8d', '599196c8-72ec-4fcd-b46f-84c017965dfd'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:42 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:42 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:43 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.486s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:43 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3 Apr 08 15:55:43 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:43 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Deleted volume successfully. Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9ce568e4-a969-44a4-852d-06251a205e92 tempest-VolumesActionsTest-110919227 None] Lock "cinder-be9b3178-94bf-4a2a-bdaf-4f6473c6662e-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:43 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3" released by "delete_volume" :: held 1.014s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Created reservations ['a842504c-d14c-4e19-a10f-e7169ab834b9', '6664ab14-fd29-4cdb-8aea-986a4bc60e47', '63446cef-5cd4-4d4c-8967-3c992e7c53f5', '4d64e4ad-e629-4b30-baac-8d811d04bf01'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:43 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:43 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:44 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.456s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Deleted volume successfully. Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-e5a6013c-41ff-4cac-856c-fc7b04378978 tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-3ae290bb-fc5b-4ab7-84a5-95dd41b2b7a3-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-ea509461-0450-4049-b74c-b34f8461f94f-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-ea509461-0450-4049-b74c-b34f8461f94f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b282bf-1efe-4ee3-8a0d-ffdd57f8321b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:44 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f Apr 08 15:55:44 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:45 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f" returned: 0 in 0.525s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:45 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f Apr 08 15:55:45 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:45 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ea509461-0450-4049-b74c-b34f8461f94f" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-quobyte-ea509461-0450-4049-b74c-b34f8461f94f" released by "delete_volume" :: held 1.054s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Created reservations ['bac1621e-413f-47fc-b112-3f5d48a2a0cb', 'c6e5dbe1-24ba-4cae-8e3c-dab40e04ccfa', '1450c843-909d-4593-9c0b-84e04dccef50', 'ce859396-cbc4-40b0-8f57-6164d57795b8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:45 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:55:45 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:46 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:46 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.408s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:46 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:55:46 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Deleted volume successfully. Apr 08 15:55:46 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ca34ea98-aab8-42e4-b7e1-8f6bfb95f65d tempest-SnapshotDependencyTests-322478983 None] Lock "cinder-ea509461-0450-4049-b74c-b34f8461f94f-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Flow 'volume_create_manager' (5fea6bd5-5111-4224-be2c-62ac0a02d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4d5073-7559-4751-ac35-5cebeffd48cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4d5073-7559-4751-ac35-5cebeffd48cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372902153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea7bd94-f2d4-4d5c-98dd-a094f919bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db89ac7062b2487daf73505881cc88e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:52Z,use_quota=True,user_id='b66042b5a38442d794dc80b93dd88ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69d486e-af7d-420e-b817-a5de07b3de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69d486e-af7d-420e-b817-a5de07b3de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06e72a9-4a05-4681-9d4a-f5b3f715ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.image.glance [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Creating Keystone auth plugin from conf {{(pid=82216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06e72a9-4a05-4681-9d4a-f5b3f715ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bea7bd94-f2d4-4d5c-98dd-a094f919bc47', 'volume_name': 'volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a78196e-e25d-4b97-9704-05a450eef5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a78196e-e25d-4b97-9704-05a450eef5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae7017-993d-46b6-a0c0-b9e351db7b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Trying to clone bea7bd94-f2d4-4d5c-98dd-a094f919bc47 from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]). {{(pid=82216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 15:55:52 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Image download 20.69 MB at 20.69 MB/s Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb6b38-7da7-43d0-9aaf-5b72310eca6b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:52 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD Apr 08 15:55:52 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:53 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 is fetched for user b66042b5a38442d794dc80b93dd88ed3. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe78ef-4df1-491e-8c5a-9ee5d5166eb3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:53 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD Apr 08 15:55:53 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:53 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372902153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea7bd94-f2d4-4d5c-98dd-a094f919bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db89ac7062b2487daf73505881cc88e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:55:52Z,use_quota=True,user_id='b66042b5a38442d794dc80b93dd88ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Creating volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:55:53 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:55:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:53 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1073741824 Apr 08 15:55:53 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:54 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1073741824" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:54 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:54 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:54 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 0 in 0.396s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Attempting download of e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ccb9b-9559-4c6d-b018-6de7d88b76f6]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:54 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b Apr 08 15:55:54 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:55 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:55 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b Apr 08 15:55:55 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:55 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b" returned: 1 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_ob_o6c_b' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc55ee-2381-4486-98c7-5d4343a452dc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:55 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD Apr 08 15:55:55 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:55 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] e5804f13-1c8e-4c0f-8b39-f65c9607d678 was qcow2, converting to raw {{(pid=82216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 15:55:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:55 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:55 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:56 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 0 in 0.868s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:56 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_len9y0sadevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:55:56 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Converted 112.00 MB image at 112.00 MB/s Apr 08 15:55:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:56 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1G Apr 08 15:55:56 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:57 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 1G" returned: 0 in 0.413s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:57 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57395e14-6138-4969-8be5-214518ca6d6c]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:57 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:57 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:57 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:57 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:57 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:58 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 1 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Downloaded image e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47 successfully. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 for user b66042b5a38442d794dc80b93dd88ed3 is deleted. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Marking volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47 as bootable. {{(pid=82216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Copying metadata from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 to bea7bd94-f2d4-4d5c-98dd-a094f919bc47. {{(pid=82216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Creating volume glance metadata for volume bea7bd94-f2d4-4d5c-98dd-a094f919bc47 backed by image e5804f13-1c8e-4c0f-8b39-f65c9607d678 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae7017-993d-46b6-a0c0-b9e351db7b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7fb279-4329-4256-8e61-696b068ff7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:55:58 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Volume volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 (bea7bd94-f2d4-4d5c-98dd-a094f919bc47): created successfully Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7fb279-4329-4256-8e61-696b068ff7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Flow 'volume_create_manager' (5fea6bd5-5111-4224-be2c-62ac0a02d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:55:58 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2056bfc5-fcba-4f2b-bf95-04156cbc1f04 tempest-VolumesImageMetadata-1422967779 None] Created volume successfully. Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Acquiring lock "cinder-bea7bd94-f2d4-4d5c-98dd-a094f919bc47-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "cinder-bea7bd94-f2d4-4d5c-98dd-a094f919bc47-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Acquiring lock "cinder-quobyte-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "cinder-quobyte-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fda3dd-a8b9-42b8-87ae-accc800ce498]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:55:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:58 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:58 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:59 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:59 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:59 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:55:59 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 08 15:55:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 1 in 0.444s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:55:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:55:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:55:59 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47 Apr 08 15:55:59 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:00 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" returned: 0 in 0.388s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "cinder-quobyte-bea7bd94-f2d4-4d5c-98dd-a094f919bc47" released by "delete_volume" :: held 1.308s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Created reservations ['343ad188-bd29-487f-b4c0-2c8cf6d165ea', 'a5ca80bb-676c-45e7-b6bc-649cdce583d0', 'a679cdd1-d420-4031-8baa-15da168b44e1', '55c1bd7b-9f8c-465b-985d-4d21ce0ba4cb'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:00 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:00 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:00 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.385s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Deleted volume successfully. Apr 08 15:56:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cb2e6ffa-d4e4-4feb-8416-c96a54e2ed0e tempest-VolumesImageMetadata-1422967779 None] Lock "cinder-bea7bd94-f2d4-4d5c-98dd-a094f919bc47-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:DELETE=14,cinder:UPDATE=167,cinder:SELECT=113,cinder:INSERT=36 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:DELETE=12,cinder:SELECT=122,cinder:UPDATE=135,cinder:INSERT=49 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Flow 'volume_create_manager' (95189a44-83e7-430c-bfe8-b0833a6ca08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3cc2fb-ca24-47dd-a98e-b5d30e932649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3cc2fb-ca24-47dd-a98e-b5d30e932649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029267242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc228703-03aa-4b6e-a4d8-92c6145060fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea779cfebdcd48918aebec47d480e931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:04Z,use_quota=True,user_id='894993c7dcc24eedb1b9ad05f7effefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e48dd7e-1cd3-421f-8e9d-12af22245b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e48dd7e-1cd3-421f-8e9d-12af22245b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b1c310-0a1f-42ee-adc5-bbf0ba990e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b1c310-0a1f-42ee-adc5-bbf0ba990e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc228703-03aa-4b6e-a4d8-92c6145060fd', 'volume_name': 'volume-cc228703-03aa-4b6e-a4d8-92c6145060fd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a24075-d226-420d-8e41-1b6a36a0f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a24075-d226-420d-8e41-1b6a36a0f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969d688a-0749-4978-9f9b-b8804080be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Volume cc228703-03aa-4b6e-a4d8-92c6145060fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc228703-03aa-4b6e-a4d8-92c6145060fd', 'volume_size': 1} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029267242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc228703-03aa-4b6e-a4d8-92c6145060fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea779cfebdcd48918aebec47d480e931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:04Z,use_quota=True,user_id='894993c7dcc24eedb1b9ad05f7effefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Creating volume cc228703-03aa-4b6e-a4d8-92c6145060fd {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:03 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:03 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd 1073741824 Apr 08 15:56:03 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:04 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd 1073741824" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:04 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd Apr 08 15:56:04 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:04 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd" returned: 0 in 0.444s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969d688a-0749-4978-9f9b-b8804080be4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc228703-03aa-4b6e-a4d8-92c6145060fd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0bf265-25e5-4322-80d2-d750a5350989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Volume volume-cc228703-03aa-4b6e-a4d8-92c6145060fd (cc228703-03aa-4b6e-a4d8-92c6145060fd): created successfully Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0bf265-25e5-4322-80d2-d750a5350989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Flow 'volume_create_manager' (95189a44-83e7-430c-bfe8-b0833a6ca08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-75afc383-7ae9-402a-bcd8-61934a140fbe tempest-VolumesTransfersTest-31496662 None] Created volume successfully. Apr 08 15:56:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a74c8b84-e8ec-404d-9d76-df00a7eb9e33 tempest-VolumesTransfersTest-1822729915 None] Transfer volume completed successfully. Apr 08 15:56:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "cinder-cc228703-03aa-4b6e-a4d8-92c6145060fd-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-cc228703-03aa-4b6e-a4d8-92c6145060fd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "cinder-quobyte-cc228703-03aa-4b6e-a4d8-92c6145060fd" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-quobyte-cc228703-03aa-4b6e-a4d8-92c6145060fd" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae07c59-82cd-43b1-8ccc-718f21b46bc1]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:07 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd Apr 08 15:56:07 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:07 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd" returned: 0 in 0.515s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:07 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd Apr 08 15:56:07 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:07 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cc228703-03aa-4b6e-a4d8-92c6145060fd" returned: 0 in 0.449s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-quobyte-cc228703-03aa-4b6e-a4d8-92c6145060fd" released by "delete_volume" :: held 0.988s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Created reservations ['adae540b-813a-4778-b6af-ae51d55e14c5', '11d76791-76cd-4a0b-98ef-e77bb0676c61', 'b9348eb1-f259-4e44-9d81-9e108099f88d', '088a40c7-1c6b-42e2-869b-462ba12bcce6'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:08 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:08 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Flow 'volume_create_manager' (84646098-76dc-41e2-bf84-9eedb7f858ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109da03b-916d-4f22-8c23-c8471e03b715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109da03b-916d-4f22-8c23-c8471e03b715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560741150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c869bc-245c-466d-8558-21bc54d6f360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea779cfebdcd48918aebec47d480e931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:08Z,use_quota=True,user_id='894993c7dcc24eedb1b9ad05f7effefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9631dc49-8f72-4e6b-a9fc-a8de4608d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9631dc49-8f72-4e6b-a9fc-a8de4608d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75190a17-f255-47e9-b42a-9b7ddcd83c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75190a17-f255-47e9-b42a-9b7ddcd83c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c869bc-245c-466d-8558-21bc54d6f360', 'volume_name': 'volume-72c869bc-245c-466d-8558-21bc54d6f360', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ddb9db-71a7-425e-bcbd-7413a38a0ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ddb9db-71a7-425e-bcbd-7413a38a0ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f319545-7b07-4ab9-9770-950b4a513ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:08 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Volume 72c869bc-245c-466d-8558-21bc54d6f360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c869bc-245c-466d-8558-21bc54d6f360', 'volume_size': 1} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560741150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c869bc-245c-466d-8558-21bc54d6f360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea779cfebdcd48918aebec47d480e931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:08Z,use_quota=True,user_id='894993c7dcc24eedb1b9ad05f7effefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Creating volume 72c869bc-245c-466d-8558-21bc54d6f360 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:08 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:08 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 1073741824 Apr 08 15:56:08 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:08 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Deleted volume successfully. Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9d36417d-966a-4783-9c8c-8bd9b674569d tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-cc228703-03aa-4b6e-a4d8-92c6145060fd-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:08 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 1073741824" returned: 0 in 0.546s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:09 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 Apr 08 15:56:09 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:09 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f319545-7b07-4ab9-9770-950b4a513ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c869bc-245c-466d-8558-21bc54d6f360', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7927859-d54f-430a-9548-4a07e8a95038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:09 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Volume volume-72c869bc-245c-466d-8558-21bc54d6f360 (72c869bc-245c-466d-8558-21bc54d6f360): created successfully Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7927859-d54f-430a-9548-4a07e8a95038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Flow 'volume_create_manager' (84646098-76dc-41e2-bf84-9eedb7f858ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-65d06f65-dfca-4274-b433-ce2e75461815 tempest-VolumesTransfersTest-31496662 None] Created volume successfully. Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "cinder-72c869bc-245c-466d-8558-21bc54d6f360-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-72c869bc-245c-466d-8558-21bc54d6f360-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "cinder-quobyte-72c869bc-245c-466d-8558-21bc54d6f360" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-quobyte-72c869bc-245c-466d-8558-21bc54d6f360" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[076a91a3-17b7-4c1a-88db-08117787967c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:10 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 Apr 08 15:56:10 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:11 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360" returned: 0 in 0.483s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:11 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360 Apr 08 15:56:11 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:11 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-72c869bc-245c-466d-8558-21bc54d6f360" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-quobyte-72c869bc-245c-466d-8558-21bc54d6f360" released by "delete_volume" :: held 0.975s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Created reservations ['d307d1dd-78bb-4bac-8bb0-48e82ec40a79', '279b0e8b-ccd0-42a4-b740-d7143db09215', 'bf3f82f1-9faa-47a6-a353-55d89eadfab3', 'ef2b8c1a-7a7c-442d-a263-546fa8b5d101'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:11 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:11 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:12 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.403s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:12 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Deleted volume successfully. Apr 08 15:56:12 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d2c5adf4-3501-4673-8723-e0481511f17e tempest-VolumesTransfersTest-1902302173 None] Lock "cinder-72c869bc-245c-466d-8558-21bc54d6f360-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Flow 'volume_create_manager' (9f804a91-b2a1-441a-b763-818c6d4fe045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fac0502-d411-4bde-ad6d-512d903657ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fac0502-d411-4bde-ad6d-512d903657ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1478625112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b983f-6d60-42c8-8bd8-f04968ba7b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9437fa8be94881b2d99fec2c4b352c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:16Z,use_quota=True,user_id='6783dc7008e14b5385d2bf85c996dc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589001f7-dc6c-4e1d-9af7-9786ea5a6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589001f7-dc6c-4e1d-9af7-9786ea5a6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646615c1-c2ca-49eb-9825-87aa214d139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646615c1-c2ca-49eb-9825-87aa214d139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9b983f-6d60-42c8-8bd8-f04968ba7b40', 'volume_name': 'volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40', 'volume_size': 2}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f2e89a-0279-4b54-b686-feffcaeff370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f2e89a-0279-4b54-b686-feffcaeff370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2411786-3d28-4d41-a5ea-2daeddd961db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:16 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Volume 3f9b983f-6d60-42c8-8bd8-f04968ba7b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40', 'volume_size': 2} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1478625112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b983f-6d60-42c8-8bd8-f04968ba7b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9437fa8be94881b2d99fec2c4b352c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:16Z,use_quota=True,user_id='6783dc7008e14b5385d2bf85c996dc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Creating volume 3f9b983f-6d60-42c8-8bd8-f04968ba7b40 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:16 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 2147483648 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:16 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 2147483648 Apr 08 15:56:16 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:16 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 2147483648" returned: 0 in 0.508s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:16 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 Apr 08 15:56:16 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:17 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" returned: 0 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2411786-3d28-4d41-a5ea-2daeddd961db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40', 'volume_size': 2}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e73b3-8113-422b-a36d-b236374417ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:17 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Volume volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 (3f9b983f-6d60-42c8-8bd8-f04968ba7b40): created successfully Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e73b3-8113-422b-a36d-b236374417ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Flow 'volume_create_manager' (9f804a91-b2a1-441a-b763-818c6d4fe045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-17362449-bf67-43d7-b785-3e4836da70c8 tempest-VolumesCloneNegativeTest-874105408 None] Created volume successfully. Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Acquiring lock "cinder-3f9b983f-6d60-42c8-8bd8-f04968ba7b40-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "cinder-3f9b983f-6d60-42c8-8bd8-f04968ba7b40-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Acquiring lock "cinder-quobyte-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "cinder-quobyte-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb4465-1d4b-4386-80b7-7a5d7bdbfec1]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:18 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 Apr 08 15:56:18 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:18 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:18 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40 Apr 08 15:56:18 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:19 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" returned: 0 in 0.392s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "cinder-quobyte-3f9b983f-6d60-42c8-8bd8-f04968ba7b40" released by "delete_volume" :: held 0.879s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Created reservations ['303b7db8-acf9-4dae-950f-0f6045335298', 'cb2a53b7-f866-46af-84b6-6b7bdd524c58', '64716fc9-5dc8-4032-b7c4-39c5d8a6c8e7', '37138462-55cb-4d40-8f5d-8af2563944e8'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:19 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:19 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:19 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Deleted volume successfully. Apr 08 15:56:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0b2068ef-146f-4edf-96e8-6facd23326f4 tempest-VolumesCloneNegativeTest-874105408 None] Lock "cinder-3f9b983f-6d60-42c8-8bd8-f04968ba7b40-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Flow 'volume_create_manager' (9caf7818-ccf6-413e-9cb6-bac00aa378b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738e3fee-7e6b-4e33-be74-55ca2e17c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738e3fee-7e6b-4e33-be74-55ca2e17c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1071467985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebddacb90d140978019eb1abd280fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:21Z,use_quota=True,user_id='73e6b5b080904a758e698edcffa517f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c53ae6-7cc2-4cc0-acd3-11a93269764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c53ae6-7cc2-4cc0-acd3-11a93269764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622c7995-3d79-4b54-bb3e-d346a692f236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.image.glance [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Creating Keystone auth plugin from conf {{(pid=82216) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622c7995-3d79-4b54-bb3e-d346a692f236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c', 'volume_name': 'volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72533f55-fe7a-4af5-af2d-fdda811bb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72533f55-fe7a-4af5-af2d-fdda811bb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99286057-368f-4aed-abab-f5326ed87074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Trying to clone 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]). {{(pid=82216) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 15:56:21 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Image download 20.69 MB at 20.69 MB/s Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c55a3-4cba-4e40-91a7-a50cccc3c279]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:21 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD Apr 08 15:56:21 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:21 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:21 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:21 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 is fetched for user 73e6b5b080904a758e698edcffa517f9. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 15:56:21 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:21 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230dd55-fe5f-4ae6-bdad-869b952a96e6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:22 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD Apr 08 15:56:22 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:22 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1071467985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebddacb90d140978019eb1abd280fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:21Z,use_quota=True,user_id='73e6b5b080904a758e698edcffa517f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Creating volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:22 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:22 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1073741824 Apr 08 15:56:22 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:22 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1073741824" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:22 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:22 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:23 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.413s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Attempting download of e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd320a5-b7b7-4721-917a-e708a804e244]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:23 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl Apr 08 15:56:23 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:23 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl" returned: 0 in 0.447s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:23 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl Apr 08 15:56:23 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:24 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl" returned: 1 in 0.453s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5804f13-1c8e-4c0f-8b39-f65c9607d678_zro7l1nl' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[001c4c98-911b-4a81-8c1a-0efc45d98cbc]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:24 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD Apr 08 15:56:24 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:24 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] e5804f13-1c8e-4c0f-8b39-f65c9607d678 was qcow2, converting to raw {{(pid=82216) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 15:56:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:24 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:24 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:25 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.809s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:25 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5804f13-1c8e-4c0f-8b39-f65c9607d678_9f5nm3pzdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:56:25 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Converted 112.00 MB image at 112.00 MB/s Apr 08 15:56:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:25 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1G Apr 08 15:56:25 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:26 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 1G" returned: 0 in 0.403s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e14de-30f5-4943-bce7-b9099601d0ff]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:26 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:26 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:26 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.438s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:26 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:26 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:26 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 1 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Downloaded image e5804f13-1c8e-4c0f-8b39-f65c9607d678 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}])) to volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c successfully. {{(pid=82216) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Temporary image e5804f13-1c8e-4c0f-8b39-f65c9607d678 for user 73e6b5b080904a758e698edcffa517f9 is deleted. {{(pid=82216) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.volume_utils [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Marking volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c as bootable. {{(pid=82216) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Copying metadata from image e5804f13-1c8e-4c0f-8b39-f65c9607d678 to 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c. {{(pid=82216) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Creating volume glance metadata for volume 5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c backed by image e5804f13-1c8e-4c0f-8b39-f65c9607d678 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82216) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99286057-368f-4aed-abab-f5326ed87074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c', 'volume_size': 1, 'image_id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30aaff71d02348d7a8e0468885d47029', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e5804f13-1c8e-4c0f-8b39-f65c9607d678', 'created_at': datetime.datetime(2026, 4, 8, 13, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 13, 44, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5804f13-1c8e-4c0f-8b39-f65c9607d678/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f349ca2c-dfc3-43ee-af1d-e61d198f34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Volume volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c (5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c): created successfully Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f349ca2c-dfc3-43ee-af1d-e61d198f34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Flow 'volume_create_manager' (9caf7818-ccf6-413e-9cb6-bac00aa378b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c5c81d7b-b057-4d7e-b52e-720603bcb11a tempest-VolumesExtendTest-805510678 None] Created volume successfully. Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b66bb6-0b12-4c2b-9432-55b4afe82653]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:27 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:27 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:27 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:28 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:28 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:28 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 1 in 0.433s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 2G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c 2G" returned: 0 in 0.029s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.932s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-15619cdc-8d1e-4196-ab59-1dc7750253ee tempest-VolumesExtendTest-805510678 None] Extend volume completed successfully. Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "cinder-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-quobyte-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76980919-879e-47ad-a241-798d4dc51ed3]: (4, 'raw') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:28 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:28 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:29 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.433s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:29 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:29 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:29 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 1 in 0.437s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c' failed. Not Retrying. {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 15:56:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:29 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c Apr 08 15:56:29 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:30 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" returned: 0 in 0.395s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c" released by "delete_volume" :: held 1.303s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Created reservations ['21b53c40-2471-4249-8ee8-434f83ccf124', 'e8100cce-4568-47da-81cf-a128c635c797', '8592e133-a749-40e4-be82-e3b50921ca99', '92174df1-f6cf-426d-91c9-6e0634dce638'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:30 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:30 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:30 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.384s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:30 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Deleted volume successfully. Apr 08 15:56:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-44e82cfb-ed28-4dc9-904d-e08175822e0a tempest-VolumesExtendTest-805510678 None] Lock "cinder-5e04709d-cb7d-448d-9a4a-0c5dc8ebb09c-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Flow 'volume_create_manager' (b0d1f21a-bd38-4fcc-9f75-6a24bbe53b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd8ec37-cc6f-45c6-ab3f-391d4eabc1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd8ec37-cc6f-45c6-ab3f-391d4eabc1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2112817125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0c8432-2def-489c-ae69-dc8391dd5325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebddacb90d140978019eb1abd280fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:31Z,use_quota=True,user_id='73e6b5b080904a758e698edcffa517f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466b5845-7869-4424-ab49-5fe2ad1da0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466b5845-7869-4424-ab49-5fe2ad1da0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f928fb24-a899-48bd-bff8-6823e1e4fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f928fb24-a899-48bd-bff8-6823e1e4fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0c8432-2def-489c-ae69-dc8391dd5325', 'volume_name': 'volume-2c0c8432-2def-489c-ae69-dc8391dd5325', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f520028-f4f1-4f59-b768-90c7fa6b5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f520028-f4f1-4f59-b768-90c7fa6b5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02bee3-082e-4733-9995-f11348bbbc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:31 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Volume 2c0c8432-2def-489c-ae69-dc8391dd5325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0c8432-2def-489c-ae69-dc8391dd5325', 'volume_size': 1} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2112817125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0c8432-2def-489c-ae69-dc8391dd5325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebddacb90d140978019eb1abd280fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:31Z,use_quota=True,user_id='73e6b5b080904a758e698edcffa517f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Creating volume 2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:31 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:31 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 1073741824 Apr 08 15:56:31 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:31 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 1073741824" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:31 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:31 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:32 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.382s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02bee3-082e-4733-9995-f11348bbbc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0c8432-2def-489c-ae69-dc8391dd5325', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c8c6d1-5174-4389-b41a-17e57b1bb0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:32 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Volume volume-2c0c8432-2def-489c-ae69-dc8391dd5325 (2c0c8432-2def-489c-ae69-dc8391dd5325): created successfully Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c8c6d1-5174-4389-b41a-17e57b1bb0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Flow 'volume_create_manager' (b0d1f21a-bd38-4fcc-9f75-6a24bbe53b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:32 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0b484604-f81a-4b2c-84e8-790634398c20 tempest-VolumesExtendTest-805510678 None] Created volume successfully. Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Creating offline snapshot 408e4888-c14b-449c-8aad-f27df445f5af of volume 2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41521d-777a-4814-b52f-36e74cb02632]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:32 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:32 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:32 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:32 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af 1G Apr 08 15:56:32 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:33 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af 1G" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0c8432-2def-489c-ae69-dc8391dd5325 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:33 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0c8432-2def-489c-ae69-dc8391dd5325 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af Apr 08 15:56:33 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:33 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0c8432-2def-489c-ae69-dc8391dd5325 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:33 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af is being set with open permissions: ugo+rw Apr 08 15:56:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:33 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af Apr 08 15:56:33 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:34 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af" returned: 0 in 0.406s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:34 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info Apr 08 15:56:34 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:34 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info" returned: 0 in 0.405s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:34 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info is being set with open permissions: ugo+rw Apr 08 15:56:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:34 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info Apr 08 15:56:34 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:34 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.info" returned: 0 in 0.412s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:35 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6552a765-e501-48b2-b883-0d122049a43b tempest-VolumesExtendTest-805510678 None] Create snapshot completed successfully Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[571e4505-4b20-4192-ae66-f7e05c7ba042]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:35 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:35 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:35 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af 2G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af 2G" returned: 0 in 0.056s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.541s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-30a0dfd7-06a2-4c28-9830-c648ea05a9d7 tempest-VolumesExtendTest-805510678 None] Extend volume completed successfully. Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-408e4888-c14b-449c-8aad-f27df445f5af-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-408e4888-c14b-449c-8aad-f27df445f5af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-quobyte-408e4888-c14b-449c-8aad-f27df445f5af" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-408e4888-c14b-449c-8aad-f27df445f5af" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Deleting offline snapshot 408e4888-c14b-449c-8aad-f27df445f5af of volume 2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] snapshot_file for this snap is: volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2663f2-373f-45c5-ab45-690299d0d134]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:36 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af Apr 08 15:56:36 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:37 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0c8432-2def-489c-ae69-dc8391dd5325(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c34d3-14f2-4d90-aa82-b09cbc8800d7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:37 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:37 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:37 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:37 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af Apr 08 15:56:37 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:38 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:38 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af Apr 08 15:56:38 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:38 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325.408e4888-c14b-449c-8aad-f27df445f5af" returned: 0 in 0.423s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-408e4888-c14b-449c-8aad-f27df445f5af" released by "_delete_snapshot" :: held 1.891s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" released by "delete_snapshot" :: held 1.904s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Created reservations ['94f64e76-4285-457b-9a14-faac1c66a9af', '1c9dbe43-a174-4f18-8bbb-33056f0b4d98', '0130adc0-475e-4a0e-806a-96bd23c46e91', 'e9c8914d-d42d-47d3-bad2-d566d3208faa'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:38 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Delete snapshot completed successfully. Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-1298fe4b-50de-44a1-8b12-87dcaffbfc03 tempest-VolumesExtendTest-805510678 None] Lock "cinder-408e4888-c14b-449c-8aad-f27df445f5af-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-2c0c8432-2def-489c-ae69-dc8391dd5325-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "cinder-2c0c8432-2def-489c-ae69-dc8391dd5325-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Acquiring lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db437c3b-5368-4c3b-a1af-deb2d7004027]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:39 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:39 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:39 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.468s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:39 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325 Apr 08 15:56:39 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:39 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2c0c8432-2def-489c-ae69-dc8391dd5325" returned: 0 in 0.419s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "cinder-quobyte-2c0c8432-2def-489c-ae69-dc8391dd5325" released by "delete_volume" :: held 0.919s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Created reservations ['291b1ffe-ad50-4237-90ab-6b220d670fcb', '424147ab-6abd-420e-9ca3-2faf81ab46ce', '89cdcb6f-30d8-4603-b82d-9c77b607646a', '9f7bf5a9-a30e-4ffc-81ae-405504ecd578'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:39 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:56:39 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:40 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.479s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:40 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:56:40 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Deleted volume successfully. Apr 08 15:56:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-59d23bde-cfaa-4d23-982b-3a0a92ae8492 tempest-VolumesExtendTest-805510678 None] Lock "cinder-2c0c8432-2def-489c-ae69-dc8391dd5325-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (17239f8f-1b2d-4fc8-b7dc-2694ca7d0059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaa8855-b3b1-4241-9534-81544893f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaa8855-b3b1-4241-9534-81544893f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076224173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedb03ed-5b1f-4f7f-bfee-76665b14a18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:47Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d3b8ee-a1d2-42d0-97e7-d0f61b8bb572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d3b8ee-a1d2-42d0-97e7-d0f61b8bb572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b57a63-2b93-4d06-a738-d517b593d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b57a63-2b93-4d06-a738-d517b593d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedb03ed-5b1f-4f7f-bfee-76665b14a18b', 'volume_name': 'volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72241ae6-07e1-4878-a864-327768dadb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72241ae6-07e1-4878-a864-327768dadb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ad51f4-ece1-4237-a5fb-deee00873093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:47 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume cedb03ed-5b1f-4f7f-bfee-76665b14a18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b', 'volume_size': 1} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076224173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedb03ed-5b1f-4f7f-bfee-76665b14a18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:47Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Creating volume cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:47 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:47 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b 1073741824 Apr 08 15:56:47 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:47 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b 1073741824" returned: 0 in 0.464s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:47 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b Apr 08 15:56:47 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:48 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" returned: 0 in 0.391s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ad51f4-ece1-4237-a5fb-deee00873093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e354571-bb8f-45cf-ac91-cd65ce206769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b (cedb03ed-5b1f-4f7f-bfee-76665b14a18b): created successfully Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e354571-bb8f-45cf-ac91-cd65ce206769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (17239f8f-1b2d-4fc8-b7dc-2694ca7d0059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:48 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-1a636f7b-098e-4b28-be72-9f330b1832b8 tempest-VolumesSnapshotTestJSON-722315903 None] Created volume successfully. Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Creating offline snapshot 79457732-3f5e-4f87-98bb-22280a2fea61 of volume cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a65ae2-bd20-4226-a80a-8dc46d104cad]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:48 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b Apr 08 15:56:48 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:49 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:49 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 1G Apr 08 15:56:49 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:49 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 1G" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:49 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 Apr 08 15:56:49 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:49 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61" returned: 0 in 0.436s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:49 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 is being set with open permissions: ugo+rw Apr 08 15:56:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:50 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 Apr 08 15:56:50 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:50 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61" returned: 0 in 0.391s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:50 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info Apr 08 15:56:50 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:50 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info" returned: 0 in 0.406s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:50 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info is being set with open permissions: ugo+rw Apr 08 15:56:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:50 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info Apr 08 15:56:50 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:51 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.info" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:51 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6e1612db-b2aa-4595-b330-38c3107aaff3 tempest-VolumesSnapshotTestJSON-722315903 None] Create snapshot completed successfully Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-79457732-3f5e-4f87-98bb-22280a2fea61-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-79457732-3f5e-4f87-98bb-22280a2fea61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-79457732-3f5e-4f87-98bb-22280a2fea61" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-79457732-3f5e-4f87-98bb-22280a2fea61" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Deleting offline snapshot 79457732-3f5e-4f87-98bb-22280a2fea61 of volume cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] snapshot_file for this snap is: volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2b2c70-8914-43f7-9c63-aae0c03a557c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:51 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 Apr 08 15:56:51 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:52 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9149205-2de3-4927-84c8-c89479a77816]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:52 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b Apr 08 15:56:52 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:52 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" returned: 0 in 0.461s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:52 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 Apr 08 15:56:52 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:53 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61" returned: 0 in 0.443s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:53 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61 Apr 08 15:56:53 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:53 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b.79457732-3f5e-4f87-98bb-22280a2fea61" returned: 0 in 0.393s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-79457732-3f5e-4f87-98bb-22280a2fea61" released by "_delete_snapshot" :: held 1.800s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" released by "delete_snapshot" :: held 1.815s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['6b80d5d7-0124-4039-9126-6a4b614bced5', '74be863a-1444-4f94-a076-6dc60c01b87a', '18443b9f-c9d8-4244-8c42-a5677464d733', 'd4264d81-1c7e-46cd-92e6-056c6a1e7b5c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:56:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Delete snapshot completed successfully. Apr 08 15:56:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbd22f07-f652-4259-b240-ddaf38fed3c9 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-79457732-3f5e-4f87-98bb-22280a2fea61-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (ae21da2d-c661-4dc8-b682-2d04c2bb259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3de90-d684-47fa-8203-5203bdb70652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3de90-d684-47fa-8203-5203bdb70652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-783000901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad830fbf-6e43-4e9a-b128-d30f47497ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:54Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684703e9-f3c4-4ae8-94dd-399f80d423fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684703e9-f3c4-4ae8-94dd-399f80d423fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce50ac7b-4f68-402f-8a9f-03587e72b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce50ac7b-4f68-402f-8a9f-03587e72b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad830fbf-6e43-4e9a-b128-d30f47497ea3', 'volume_name': 'volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef1f7d5-f6fb-408f-9abe-feee8025c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef1f7d5-f6fb-408f-9abe-feee8025c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d340aa-2166-49de-a7b5-37f4ede0b563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume ad830fbf-6e43-4e9a-b128-d30f47497ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3', 'volume_size': 1} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-783000901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad830fbf-6e43-4e9a-b128-d30f47497ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:54Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Creating volume ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:54 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:54 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 1073741824 Apr 08 15:56:54 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:54 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 1073741824" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:54 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:56:54 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:55 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.396s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d340aa-2166-49de-a7b5-37f4ede0b563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c17cfd5-3b99-4c0e-9e4d-9a2aee419cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:55 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Volume volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 (ad830fbf-6e43-4e9a-b128-d30f47497ea3): created successfully Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c17cfd5-3b99-4c0e-9e4d-9a2aee419cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (ae21da2d-c661-4dc8-b682-2d04c2bb259a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:55 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b41cc43d-1c85-4500-8f4e-c6f3712e93b8 tempest-VolumesSnapshotTestJSON-722315903 None] Created volume successfully. Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Creating offline snapshot 0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 of volume ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a5087f-dccb-4808-8f91-deef0cac5dc9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:55 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:56:55 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:55 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:55 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 1G Apr 08 15:56:55 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:56 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 1G" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:56 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:56:56 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:56 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.425s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:56 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 is being set with open permissions: ugo+rw Apr 08 15:56:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:56 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:56:56 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:57 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.401s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:57 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info Apr 08 15:56:57 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:57 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info" returned: 0 in 0.403s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:57 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info is being set with open permissions: ugo+rw Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:57 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info Apr 08 15:56:57 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:57 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.info" returned: 0 in 0.391s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e6006cfd-bd51-4a52-9666-ca21299ec27b tempest-VolumesSnapshotTestJSON-722315903 None] Create snapshot completed successfully Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (8640a589-bdb9-4715-9627-fffbbcb9c583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a31eac-60f9-4ad9-a6f8-96e1c78055c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a31eac-60f9-4ad9-a6f8-96e1c78055c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-642434934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385534c4-e0f6-433f-aa6f-b2706c0c7a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:56:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:56:59Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e12c6b-a46d-4422-b557-5d9ed162b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e12c6b-a46d-4422-b557-5d9ed162b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167c6cce-9edd-4c69-b082-a2eb80ff2dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167c6cce-9edd-4c69-b082-a2eb80ff2dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '385534c4-e0f6-433f-aa6f-b2706c0c7a24', 'volume_name': 'volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24', 'volume_size': 2, 'snapshot_id': '0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2e09e4-187d-4592-8716-81e5520dec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2e09e4-187d-4592-8716-81e5520dec10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a862f40-46c1-4c4f-bc87-4307d1a4364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:56:58 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Volume 385534c4-e0f6-433f-aa6f-b2706c0c7a24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24', 'volume_size': 2, 'snapshot_id': '0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9'} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-385534c4-e0f6-433f-aa6f-b2706c0c7a24" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-385534c4-e0f6-433f-aa6f-b2706c0c7a24" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Creating volume 385534c4-e0f6-433f-aa6f-b2706c0c7a24 from snapshot 0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] snapshot: 0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9, volume: 385534c4-e0f6-433f-aa6f-b2706c0c7a24, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f022f-9513-40c9-981e-606b7cc6a78f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:58 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:56:58 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:59 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9357e-9002-4ca8-ab0b-b0ab0df422fd]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:59 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:56:59 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:56:59 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.462s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:56:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:56:59 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 Apr 08 15:56:59 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:01 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24" returned: 0 in 1.854s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1abfe-a972-48a5-bfe7-9de25cd9e671]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:01 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:57:01 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:02 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.587s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:57:02 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Converted 1024.00 MB image at 552.04 MB/s Apr 08 15:57:02 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 is being set with open permissions: ugo+rw Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:02 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 Apr 08 15:57:02 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:02 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24" returned: 0 in 0.400s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" released by "_copy_volume_from_snapshot" :: held 3.801s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-385534c4-e0f6-433f-aa6f-b2706c0c7a24" released by "_create_volume_from_snapshot" :: held 3.818s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.826s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a862f40-46c1-4c4f-bc87-4307d1a4364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24', 'volume_size': 2, 'snapshot_id': '0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5644aff5-6331-42a1-9570-b309413c619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:02 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Volume volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 (385534c4-e0f6-433f-aa6f-b2706c0c7a24): created successfully Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5644aff5-6331-42a1-9570-b309413c619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:02 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (8640a589-bdb9-4715-9627-fffbbcb9c583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3b6489b7-a45b-40aa-85b5-bfd73d16e4a1 tempest-VolumesSnapshotTestJSON-722315903 None] Created volume successfully. Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-385534c4-e0f6-433f-aa6f-b2706c0c7a24-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-385534c4-e0f6-433f-aa6f-b2706c0c7a24-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f446f5d-e116-41d0-8ce5-78e466663704]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:03 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 Apr 08 15:57:03 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:03 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24" returned: 0 in 0.467s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:03 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24 Apr 08 15:57:03 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:03 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-385534c4-e0f6-433f-aa6f-b2706c0c7a24" returned: 0 in 0.420s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-385534c4-e0f6-433f-aa6f-b2706c0c7a24" released by "delete_volume" :: held 0.911s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:UPDATE=86,cinder:INSERT=19,cinder:SELECT=77,cinder:DELETE=7 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=86,cinder:UPDATE=85,cinder:DELETE=9,cinder:INSERT=32 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['4866f535-a839-40ce-8a7d-73eece5bac72', '976506b1-b4a1-4697-90d1-7a01a044468e', 'c16896a9-ed7e-4a39-abb5-aef82b3c8d21', '94dc5d0b-eff9-43c0-9562-0e3699df8415'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:04 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:04 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Deleting offline snapshot 0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 of volume ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] snapshot_file for this snap is: volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82cb305-6a9e-4655-af75-5c572e328bad]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:04 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:57:04 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:04 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.443s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:04 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Deleted volume successfully. Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d972a017-c8c9-4aeb-841e-8a7aa0b89077 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-385534c4-e0f6-433f-aa6f-b2706c0c7a24-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:04 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f587aa-16e3-41db-ae2d-b5121c53559d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:04 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:57:04 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:05 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:05 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:57:05 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:05 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:05 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9 Apr 08 15:57:05 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:06 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3.0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9" released by "_delete_snapshot" :: held 1.899s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" released by "delete_snapshot" :: held 1.910s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['1408e523-9d0b-4020-bfd5-df4d88189702', 'c865cbe9-f579-43cf-8ba9-7b37517d2b4e', '5d5c23a8-ad16-432a-9bc2-dde2f4d43f01', '5bf08acb-ef55-43b3-87d5-de3784ea4567'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Delete snapshot completed successfully. Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f5665911-1e48-42ca-9cd4-1d67d738f3dd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-0ba9ecaf-9ef1-4496-8fbf-8754ea4e56b9-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-ad830fbf-6e43-4e9a-b128-d30f47497ea3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-ad830fbf-6e43-4e9a-b128-d30f47497ea3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccc4197-d36e-4cb9-8c70-2b024602fed3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:06 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:57:06 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:06 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:06 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3 Apr 08 15:57:06 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:07 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ad830fbf-6e43-4e9a-b128-d30f47497ea3" returned: 0 in 0.427s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ad830fbf-6e43-4e9a-b128-d30f47497ea3" released by "delete_volume" :: held 0.939s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['3f2584c9-7036-435f-9e48-662bcfa92d50', '523effcc-9dea-48e0-a8ae-0d6a25de1773', 'd776d88f-1742-4662-b7c6-23851cc41e7b', '480bfcd6-7b63-4c7f-974c-d8b06df639da'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:07 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:07 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (e9f285a0-4839-463e-98aa-5865585044c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd942f45-1d18-43c4-9cf6-96b02d68607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd942f45-1d18-43c4-9cf6-96b02d68607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271349246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534f791a-8f47-4c83-9ccc-9052055fb279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:08Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dc6104-d7b2-4026-99e2-25a3989a525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dc6104-d7b2-4026-99e2-25a3989a525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9e5d49-30aa-4b38-9ae5-4c554c382894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9e5d49-30aa-4b38-9ae5-4c554c382894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534f791a-8f47-4c83-9ccc-9052055fb279', 'volume_name': 'volume-534f791a-8f47-4c83-9ccc-9052055fb279', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af8f39-1e81-4870-92a6-7b11050a1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af8f39-1e81-4870-92a6-7b11050a1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94db14f-ca3b-4811-bd77-b42a7f3b3a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:07 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Volume 534f791a-8f47-4c83-9ccc-9052055fb279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534f791a-8f47-4c83-9ccc-9052055fb279', 'volume_size': 1} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271349246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534f791a-8f47-4c83-9ccc-9052055fb279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:08Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Creating volume 534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:07 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:07 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 1073741824 Apr 08 15:57:07 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:07 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Deleted volume successfully. Apr 08 15:57:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ec2e5a40-49f3-4f9b-b6e0-c6ce65278a29 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-ad830fbf-6e43-4e9a-b128-d30f47497ea3-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:08 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 1073741824" returned: 0 in 0.493s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:08 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:08 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:08 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.419s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94db14f-ca3b-4811-bd77-b42a7f3b3a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534f791a-8f47-4c83-9ccc-9052055fb279', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927d7a1-651b-4bd3-9da9-bb978538b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:08 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Volume volume-534f791a-8f47-4c83-9ccc-9052055fb279 (534f791a-8f47-4c83-9ccc-9052055fb279): created successfully Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927d7a1-651b-4bd3-9da9-bb978538b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:08 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (e9f285a0-4839-463e-98aa-5865585044c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:08 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a4d74088-1ef9-4a79-b492-b5e2eeb5394b tempest-VolumesSnapshotTestJSON-722315903 None] Created volume successfully. Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Creating offline snapshot 6df1ae21-e395-4b9e-846c-1843d6a84c06 of volume 534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fb930-83ed-494f-9aa0-f4862e5afce0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:10 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:10 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:10 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.467s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:10 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 1G Apr 08 15:57:10 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:10 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 1G" returned: 0 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534f791a-8f47-4c83-9ccc-9052055fb279 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:10 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534f791a-8f47-4c83-9ccc-9052055fb279 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:10 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:11 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534f791a-8f47-4c83-9ccc-9052055fb279 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:11 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 is being set with open permissions: ugo+rw Apr 08 15:57:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:11 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:11 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:11 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.399s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:11 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info Apr 08 15:57:11 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:12 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info" returned: 0 in 0.396s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:12 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info is being set with open permissions: ugo+rw Apr 08 15:57:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:12 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info Apr 08 15:57:12 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:12 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.info" returned: 0 in 0.381s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4b225650-4e73-462e-804a-a0dbd73eb0fd tempest-VolumesSnapshotTestJSON-722315903 None] Create snapshot completed successfully Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (99655aa7-8eab-4d4a-aae9-0f154f3f5668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c20e15-b049-47c2-95b4-2a1f1272f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c20e15-b049-47c2-95b4-2a1f1272f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1747955363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8b3a79-b8cd-4bb1-ba75-fe5b27946731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d64f2939adc476f9d32d80acb5e00e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6df1ae21-e395-4b9e-846c-1843d6a84c06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:13Z,use_quota=True,user_id='621c406ea5be47fd868030bb0b20bc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14cfa95-6891-432a-a3de-5e4d3008a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14cfa95-6891-432a-a3de-5e4d3008a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e62716-1338-4c5c-934a-4bea7822dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e62716-1338-4c5c-934a-4bea7822dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac8b3a79-b8cd-4bb1-ba75-fe5b27946731', 'volume_name': 'volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731', 'volume_size': 1, 'snapshot_id': '6df1ae21-e395-4b9e-846c-1843d6a84c06'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe2b970-459e-4397-9aa4-634de46410d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe2b970-459e-4397-9aa4-634de46410d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67483324-2e9e-4eb5-b22c-20e4a78b70e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:13 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Volume ac8b3a79-b8cd-4bb1-ba75-fe5b27946731: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731', 'volume_size': 1, 'snapshot_id': '6df1ae21-e395-4b9e-846c-1843d6a84c06'} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Creating volume ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 from snapshot 6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] snapshot: 6df1ae21-e395-4b9e-846c-1843d6a84c06, volume: ac8b3a79-b8cd-4bb1-ba75-fe5b27946731, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf1ae39-20c8-4a93-9603-8ecb30edb4e5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:13 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:13 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:13 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.475s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-534f791a-8f47-4c83-9ccc-9052055fb279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a90df9-1015-4f88-9b77-c3a27e4a504c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:14 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:14 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:14 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:14 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:57:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:14 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 Apr 08 15:57:14 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:16 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" returned: 0 in 1.818s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b137db3b-5708-424c-bd29-15b6d58fa684]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:16 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:16 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:16 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.564s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:57:16 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Converted 1024.00 MB image at 562.77 MB/s Apr 08 15:57:16 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 is being set with open permissions: ugo+rw Apr 08 15:57:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:16 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 Apr 08 15:57:16 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:17 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" returned: 0 in 0.390s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" released by "_copy_volume_from_snapshot" :: held 3.764s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" released by "_create_volume_from_snapshot" :: held 3.786s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.794s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67483324-2e9e-4eb5-b22c-20e4a78b70e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731', 'volume_size': 1, 'snapshot_id': '6df1ae21-e395-4b9e-846c-1843d6a84c06'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3c9ae-f338-45b3-8c12-4970233cfc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:17 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Volume volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 (ac8b3a79-b8cd-4bb1-ba75-fe5b27946731): created successfully Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3c9ae-f338-45b3-8c12-4970233cfc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Flow 'volume_create_manager' (99655aa7-8eab-4d4a-aae9-0f154f3f5668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-aa183043-9d7a-4b46-9275-8462249ea3ee tempest-VolumesSnapshotTestJSON-722315903 None] Created volume successfully. Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad1395e-3ec9-4f61-827c-3add12f6a5a8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:17 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 Apr 08 15:57:17 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:18 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:18 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731 Apr 08 15:57:18 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:18 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" returned: 0 in 0.407s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731" released by "delete_volume" :: held 0.913s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['effb1bb4-11d8-4a4d-8035-bdcc4b7cc1eb', 'deb37cbe-a1f5-4cd0-934b-442f891efd47', 'b005a7da-4fbd-487e-818c-062f768ddeb5', 'a460aff4-aaab-41f2-b68b-9c5a830b64ba'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:18 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:18 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-6df1ae21-e395-4b9e-846c-1843d6a84c06-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-6df1ae21-e395-4b9e-846c-1843d6a84c06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Deleting offline snapshot 6df1ae21-e395-4b9e-846c-1843d6a84c06 of volume 534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] snapshot_file for this snap is: volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35421f2-ab05-4176-9682-85331db4d118]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:18 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:18 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:19 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.417s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Deleted volume successfully. Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f3e9b077-605b-43c4-9f22-0df37e871a7b tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-ac8b3a79-b8cd-4bb1-ba75-fe5b27946731-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:19 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-534f791a-8f47-4c83-9ccc-9052055fb279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adcbb05-7b37-4f3b-b5b2-8ee30e004f14]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:19 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:19 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:19 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:19 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:19 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:20 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.448s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:20 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06 Apr 08 15:57:20 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:20 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279.6df1ae21-e395-4b9e-846c-1843d6a84c06" returned: 0 in 0.392s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-6df1ae21-e395-4b9e-846c-1843d6a84c06" released by "_delete_snapshot" :: held 1.816s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" released by "delete_snapshot" :: held 1.832s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['4efd7137-f2fd-4ab2-a0b0-8d032db8bbab', '9f44b1dc-5df3-4846-b925-90f9ca5f6d01', '913b6d83-cb43-4020-84db-613d1d214bce', '89f9ae00-d497-4fed-9f62-64ae42eae291'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:20 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Delete snapshot completed successfully. Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22f03569-ffb0-49fe-b85e-0cfb3b6f16b8 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-6df1ae21-e395-4b9e-846c-1843d6a84c06-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-534f791a-8f47-4c83-9ccc-9052055fb279-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-534f791a-8f47-4c83-9ccc-9052055fb279-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d977bc3d-5158-4b41-a09f-2931dafb74ea]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:21 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:21 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:21 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:21 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279 Apr 08 15:57:21 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:21 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:21 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:21 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-534f791a-8f47-4c83-9ccc-9052055fb279" returned: 0 in 0.406s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-534f791a-8f47-4c83-9ccc-9052055fb279" released by "delete_volume" :: held 0.893s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['fcc64cf0-465b-4960-8573-a9822cde5f5b', 'a75809b7-bdf2-4c12-84bc-35367bea54c0', 'e889f58a-5b20-4c5a-bcdb-853606f61825', 'c7c10bb5-db70-46f4-8d94-0f4f0b06ada1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:21 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.412s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:22 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:22 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-cedb03ed-5b1f-4f7f-bfee-76665b14a18b-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-cedb03ed-5b1f-4f7f-bfee-76665b14a18b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a1feec-1dcf-461d-bc01-f9a9b8a0bef7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:22 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b Apr 08 15:57:22 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:22 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.437s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Deleted volume successfully. Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-f4c70b60-f301-4d26-8cdc-8bc2b1f83263 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-534f791a-8f47-4c83-9ccc-9052055fb279-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:22 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:22 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b Apr 08 15:57:22 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:23 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" returned: 0 in 0.391s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-quobyte-cedb03ed-5b1f-4f7f-bfee-76665b14a18b" released by "delete_volume" :: held 0.888s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Created reservations ['a08f2030-3d7a-418d-b716-059144ac8c60', '5690f2bd-2b63-42e5-9f85-aca7326da2d8', 'cee8dabb-9863-4584-8497-68bd755374c7', '55f34e6d-bfbf-4d3a-a058-1571e4ada3cb'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:23 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:23 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:23 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.422s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Deleted volume successfully. Apr 08 15:57:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d4c56028-7e22-46e0-9a71-5679b39682c0 tempest-VolumesSnapshotTestJSON-722315903 None] Lock "cinder-cedb03ed-5b1f-4f7f-bfee-76665b14a18b-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Flow 'volume_create_manager' (d9a03378-53ee-4fb4-9f6c-f888eb94ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd0774d-ed7c-4cd0-8f73-f9864b92de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd0774d-ed7c-4cd0-8f73-f9864b92de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-331050460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cdf802-3128-4add-8f5f-887fd8348402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8bb085b1e4c4cb03dba513485deaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:27Z,use_quota=True,user_id='a6d689fcd50b4b53b84ec7c18bb917c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c24b71-e5ef-417d-a1fd-7189cdaeb8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c24b71-e5ef-417d-a1fd-7189cdaeb8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1bb2a0-4939-4dc5-8e0d-885778d2c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1bb2a0-4939-4dc5-8e0d-885778d2c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cdf802-3128-4add-8f5f-887fd8348402', 'volume_name': 'volume-99cdf802-3128-4add-8f5f-887fd8348402', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c1a66a-45b0-40e4-90c0-1ce674e2e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c1a66a-45b0-40e4-90c0-1ce674e2e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ddcde9-752d-4655-abf1-a0276f03ec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Volume 99cdf802-3128-4add-8f5f-887fd8348402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cdf802-3128-4add-8f5f-887fd8348402', 'volume_size': 1} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-331050460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cdf802-3128-4add-8f5f-887fd8348402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8bb085b1e4c4cb03dba513485deaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:27Z,use_quota=True,user_id='a6d689fcd50b4b53b84ec7c18bb917c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Creating volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:26 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 1073741824 Apr 08 15:57:26 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:27 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 1073741824" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:27 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 Apr 08 15:57:27 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:27 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402" returned: 0 in 0.392s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ddcde9-752d-4655-abf1-a0276f03ec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cdf802-3128-4add-8f5f-887fd8348402', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd27f9f-2316-4a8c-8f84-d655d08b7453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Volume volume-99cdf802-3128-4add-8f5f-887fd8348402 (99cdf802-3128-4add-8f5f-887fd8348402): created successfully Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd27f9f-2316-4a8c-8f84-d655d08b7453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Flow 'volume_create_manager' (d9a03378-53ee-4fb4-9f6c-f888eb94ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5c90620e-cc3b-46c1-bfab-6dd3083738b5 tempest-VolumesSnapshotListTestJSON-1392771567 None] Created volume successfully. Apr 08 15:57:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Creating offline snapshot ba6f9008-0c1b-4e9a-91d7-44d4c4194cae of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:57:28 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb203b4-55bd-485b-861c-69a1a5a1bbd4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:29 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 Apr 08 15:57:29 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:29 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402" returned: 0 in 0.441s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:29 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae 1G Apr 08 15:57:29 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:29 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae 1G" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:29 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:29 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:30 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.431s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:30 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae is being set with open permissions: ugo+rw Apr 08 15:57:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:30 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:30 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:30 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.411s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:30 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info Apr 08 15:57:30 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:31 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:31 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info is being set with open permissions: ugo+rw Apr 08 15:57:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:31 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info Apr 08 15:57:31 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:31 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.info" returned: 0 in 0.409s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:31 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-75d2b45b-b050-4d98-b8a6-7156db873fd2 tempest-VolumesSnapshotListTestJSON-1392771567 None] Create snapshot completed successfully Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Creating offline snapshot 44218d73-eb73-4738-9627-6a52d6ccbe0a of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b6c9f-7503-4cc5-bb2c-8be10aba428d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:32 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:32 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:32 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.521s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:32 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a 1G Apr 08 15:57:32 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:33 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a 1G" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:33 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:33 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:33 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:33 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a is being set with open permissions: ugo+rw Apr 08 15:57:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:33 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:33 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:34 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.397s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6583b896-75c2-4ae3-b0d4-9cbaa6de9157 tempest-VolumesSnapshotListTestJSON-1392771567 None] Create snapshot completed successfully Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Creating offline snapshot a5e1beaf-a395-4310-853d-f78abc8560d5 of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f17a2-bdab-4ff1-9dc7-2eea10793c7e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:34 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:34 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:34 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:34 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 1G Apr 08 15:57:34 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:35 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 1G" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:35 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 Apr 08 15:57:35 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:35 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:35 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 is being set with open permissions: ugo+rw Apr 08 15:57:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:35 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 Apr 08 15:57:35 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:36 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5" returned: 0 in 0.393s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:36 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-36818e3b-e301-493e-bef6-801812a15dc0 tempest-VolumesSnapshotListTestJSON-1392771567 None] Create snapshot completed successfully Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-a5e1beaf-a395-4310-853d-f78abc8560d5-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-a5e1beaf-a395-4310-853d-f78abc8560d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-a5e1beaf-a395-4310-853d-f78abc8560d5" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-a5e1beaf-a395-4310-853d-f78abc8560d5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Deleting offline snapshot a5e1beaf-a395-4310-853d-f78abc8560d5 of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] snapshot_file for this snap is: volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[290634e7-0ec2-4a89-9177-2fcc71b3dcec]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:37 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 Apr 08 15:57:37 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:37 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5" returned: 0 in 0.465s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2325d74-aadd-4d0a-95d9-e8dee3d04078]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:37 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:37 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:38 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:38 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 Apr 08 15:57:38 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:38 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5" returned: 0 in 0.494s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:38 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5 Apr 08 15:57:38 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:38 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.a5e1beaf-a395-4310-853d-f78abc8560d5" returned: 0 in 0.433s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-a5e1beaf-a395-4310-853d-f78abc8560d5" released by "_delete_snapshot" :: held 1.927s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" released by "delete_snapshot" :: held 1.941s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Created reservations ['bebd218f-babb-4ab6-a02b-b9c4067b2c82', 'c1b1e5f2-4e19-4423-afa3-67a6a4fb75b8', '76cff04f-a575-44fb-b038-9b33a3bcba30', '9e919347-24b7-4f02-a3bb-efb7490a0ee1'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Delete snapshot completed successfully. Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-11365353-dd79-47ad-a896-e6b3d4c1a337 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-a5e1beaf-a395-4310-853d-f78abc8560d5-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-44218d73-eb73-4738-9627-6a52d6ccbe0a-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-44218d73-eb73-4738-9627-6a52d6ccbe0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-44218d73-eb73-4738-9627-6a52d6ccbe0a" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-44218d73-eb73-4738-9627-6a52d6ccbe0a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Deleting offline snapshot 44218d73-eb73-4738-9627-6a52d6ccbe0a of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] snapshot_file for this snap is: volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8194e1d-0757-493b-8136-c82dda25975e]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:39 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:39 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:39 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b33d8-bcce-4d1c-804d-0485dab744fd]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:39 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:39 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:40 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:40 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:40 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:40 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:40 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:40 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a Apr 08 15:57:40 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:41 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.44218d73-eb73-4738-9627-6a52d6ccbe0a" returned: 0 in 0.389s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-44218d73-eb73-4738-9627-6a52d6ccbe0a" released by "_delete_snapshot" :: held 1.863s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" released by "delete_snapshot" :: held 1.874s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Created reservations ['b477a483-e100-4faf-a2ba-1fe33aeef14f', '64bb90a5-f1b0-430f-81de-44aa86266639', '8b8d88fe-1737-426d-a053-4681a27f7490', 'a7f53a3c-0069-4ff8-835e-7de59a50346c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Delete snapshot completed successfully. Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-cced0827-659c-4eb7-ae80-8f8c65ea7dc1 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-44218d73-eb73-4738-9627-6a52d6ccbe0a-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Deleting offline snapshot ba6f9008-0c1b-4e9a-91d7-44d4c4194cae of volume 99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] snapshot_file for this snap is: volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[099cffbd-b337-418d-9590-4dc5b1e07d58]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:41 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:41 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:41 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.474s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cdf802-3128-4add-8f5f-887fd8348402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a5291-58db-4314-b5ac-a2ca4a2b3dfd]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:41 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 Apr 08 15:57:41 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:42 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402" returned: 0 in 0.454s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:42 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:42 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:42 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:42 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae Apr 08 15:57:42 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:43 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402.ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" returned: 0 in 0.389s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae" released by "_delete_snapshot" :: held 1.799s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" released by "delete_snapshot" :: held 1.815s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Created reservations ['77d23316-e5c2-432d-81d0-6ae6e3bf9396', 'c3f60b2d-758c-440e-8d27-1a0bc652ca8b', '4808931d-eb58-4dac-8e6e-4118f9d67ea7', '7cde41c5-c770-46ec-acf9-5d33865636ce'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Delete snapshot completed successfully. Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c249e7bd-9d6c-4246-96e2-81c487dab151 tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-ba6f9008-0c1b-4e9a-91d7-44d4c4194cae-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-99cdf802-3128-4add-8f5f-887fd8348402-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-99cdf802-3128-4add-8f5f-887fd8348402-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3252c6-7eba-4652-bf00-16be469d865b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:43 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 Apr 08 15:57:43 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:43 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:43 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402 Apr 08 15:57:43 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:44 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-99cdf802-3128-4add-8f5f-887fd8348402" returned: 0 in 0.387s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-quobyte-99cdf802-3128-4add-8f5f-887fd8348402" released by "delete_volume" :: held 0.907s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Created reservations ['1da0ff9e-f3b1-4f1d-be26-ec26d5efb229', 'ce5236df-7ca8-4550-b173-295abf0fbedb', 'f3f7e4b9-5c8a-4d3d-abb7-657afdeea265', '81a19f4e-fc2d-45b0-be85-34dd878d6686'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:44 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:57:44 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:44 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:57:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Deleted volume successfully. Apr 08 15:57:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8ea8eabc-15c4-4564-ba1f-40e5534d396f tempest-VolumesSnapshotListTestJSON-1392771567 None] Lock "cinder-99cdf802-3128-4add-8f5f-887fd8348402-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (2f769f27-ad4e-40ea-890f-cce52285765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41116c9f-95ba-4caa-80cb-504463d85f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41116c9f-95ba-4caa-80cb-504463d85f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174101295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d65fc59-05eb-4666-88dc-bd7c21cf7ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:51Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfa5b5e-18ad-43c9-9430-61dcfabdda2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfa5b5e-18ad-43c9-9430-61dcfabdda2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9dbaaa-9574-4e69-afac-633adb72a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9dbaaa-9574-4e69-afac-633adb72a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d65fc59-05eb-4666-88dc-bd7c21cf7ddf', 'volume_name': 'volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85216561-93ee-47d9-9d49-b230ccd73582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85216561-93ee-47d9-9d49-b230ccd73582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ee4f4-11d8-4d8b-a168-fbc5e2c60689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Volume 9d65fc59-05eb-4666-88dc-bd7c21cf7ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf', 'volume_size': 1} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-174101295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d65fc59-05eb-4666-88dc-bd7c21cf7ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:51Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Creating volume 9d65fc59-05eb-4666-88dc-bd7c21cf7ddf {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Flow 'volume_create_manager' (eba05c25-9e0c-4a55-8b19-9bdf84ad030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:51 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf 1073741824 Apr 08 15:57:51 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d8ece9-7d16-45f2-8abd-add3806389ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d8ece9-7d16-45f2-8abd-add3806389ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb2a13-f45c-4d7f-b18a-abf4f5b11015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8493308163b646319d7f38c9dfdfd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:51Z,use_quota=True,user_id='5d0d6bb32c2544a1a5f6cdc737ce8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352dbbaf-bd26-456e-9355-6828c6c4048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352dbbaf-bd26-456e-9355-6828c6c4048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afab7a4-3db0-459e-bf62-40ada05d9a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afab7a4-3db0-459e-bf62-40ada05d9a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfeb2a13-f45c-4d7f-b18a-abf4f5b11015', 'volume_name': 'volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397abb3-c7bb-4ae4-8d05-5be1b0cc1165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397abb3-c7bb-4ae4-8d05-5be1b0cc1165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd744995-01f0-4f4d-85ca-e0f1b87131f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Volume dfeb2a13-f45c-4d7f-b18a-abf4f5b11015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015', 'volume_size': 1} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (b55febdd-ae94-46aa-a7ea-17c4aba254c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d0e2a-988e-4bd9-b8e7-8af64eb6304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d0e2a-988e-4bd9-b8e7-8af64eb6304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905014930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebf3a77-7301-43cf-96af-86ead4760efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b37590-d0d8-4524-bb07-ac0cb6778d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b37590-d0d8-4524-bb07-ac0cb6778d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd48eeb8-3e58-4bcb-972a-2d173ca29479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd48eeb8-3e58-4bcb-972a-2d173ca29479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebf3a77-7301-43cf-96af-86ead4760efe', 'volume_name': 'volume-cebf3a77-7301-43cf-96af-86ead4760efe', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7f96db-b2e5-485d-996c-d4648f5021da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7f96db-b2e5-485d-996c-d4648f5021da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b87c73e-7fd9-47af-8781-163fed069d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume cebf3a77-7301-43cf-96af-86ead4760efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebf3a77-7301-43cf-96af-86ead4760efe', 'volume_size': 1} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (db70f3f0-e5a3-44d1-9895-e16c648f63ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ea9078-d54d-4c80-be17-7a7e5c6630b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ea9078-d54d-4c80-be17-7a7e5c6630b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-442836166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aefb8c-3516-4d28-96ac-8d416d0c5912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7297b5b-b1aa-46b0-b867-45198c07bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7297b5b-b1aa-46b0-b867-45198c07bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a60abf-a336-4eb7-9bfa-2f4c0641d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a60abf-a336-4eb7-9bfa-2f4c0641d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73aefb8c-3516-4d28-96ac-8d416d0c5912', 'volume_name': 'volume-73aefb8c-3516-4d28-96ac-8d416d0c5912', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618c8c0-252e-40a0-a40f-963466b07b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1618c8c0-252e-40a0-a40f-963466b07b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5561c51e-3127-463c-871a-d0b95120c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Volume 73aefb8c-3516-4d28-96ac-8d416d0c5912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73aefb8c-3516-4d28-96ac-8d416d0c5912', 'volume_size': 1} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (8c2f7b72-2f77-404b-9484-22bd2560a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4180256-1578-4ef3-b7fc-525719fca38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4180256-1578-4ef3-b7fc-525719fca38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717010433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c75836f-4b87-439d-a313-da6bc8d9eeb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9746504e-aae5-483e-98ba-9cbf2281e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9746504e-aae5-483e-98ba-9cbf2281e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99799fa-4dd4-4ab8-a342-df3466ba4551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99799fa-4dd4-4ab8-a342-df3466ba4551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c75836f-4b87-439d-a313-da6bc8d9eeb9', 'volume_name': 'volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6feb3e-85af-491a-91c6-b2703ef0efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6feb3e-85af-491a-91c6-b2703ef0efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad56ae-e3d2-4c0d-8bdf-29f06a8d15f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:51 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Volume 7c75836f-4b87-439d-a313-da6bc8d9eeb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9', 'volume_size': 1} Apr 08 15:57:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (b8861ac8-a95b-4a86-878b-6f3bf2051c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20132c-a670-4591-9d55-0bab8dbae1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20132c-a670-4591-9d55-0bab8dbae1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-946256541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cc080f-ec97-45ed-b763-c07408feefb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de5928b-99b4-4295-abbf-5293750f873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de5928b-99b4-4295-abbf-5293750f873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f17c05-d112-44ea-8e5d-969acac20191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f17c05-d112-44ea-8e5d-969acac20191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cc080f-ec97-45ed-b763-c07408feefb4', 'volume_name': 'volume-95cc080f-ec97-45ed-b763-c07408feefb4', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889ace34-111d-43a4-ac9d-70d2914941c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889ace34-111d-43a4-ac9d-70d2914941c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd607bc-e64c-4caa-aa41-33c4ec98da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Volume 95cc080f-ec97-45ed-b763-c07408feefb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cc080f-ec97-45ed-b763-c07408feefb4', 'volume_size': 1} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:52 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf 1073741824" returned: 0 in 0.646s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:52 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf Apr 08 15:57:52 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (e3a1087f-c4c0-4815-8407-e3e9a3348a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b6e7a9-6e76-404f-9aff-35e609ea3a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b6e7a9-6e76-404f-9aff-35e609ea3a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1048370875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ac32f3-62df-4b93-b705-6c2c859ba4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183161a4-07a0-4818-abf6-362ffa031a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183161a4-07a0-4818-abf6-362ffa031a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9de9a4-5e70-4e57-9e21-20b8ca162e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9de9a4-5e70-4e57-9e21-20b8ca162e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ac32f3-62df-4b93-b705-6c2c859ba4ee', 'volume_name': 'volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb42a72a-9a46-45fb-89b8-f3e60cb2f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb42a72a-9a46-45fb-89b8-f3e60cb2f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf162025-3a79-4bcf-805d-8ca4ee9c5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Volume a8ac32f3-62df-4b93-b705-6c2c859ba4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee', 'volume_size': 1} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (a5dd237e-0f93-482b-8327-390f6af96666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc2d594-10bf-44df-8912-aa756a76706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc2d594-10bf-44df-8912-aa756a76706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125717513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45bec7c-0dd5-41ed-81a6-973f694d0c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caeeeb2-37b7-44f6-a322-efd1a277ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caeeeb2-37b7-44f6-a322-efd1a277ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4855cb49-03cb-44b9-ba7f-044de6aac69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4855cb49-03cb-44b9-ba7f-044de6aac69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45bec7c-0dd5-41ed-81a6-973f694d0c2a', 'volume_name': 'volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f0cadd-909b-4626-bab3-08a006cabc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f0cadd-909b-4626-bab3-08a006cabc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b949f-61b6-4586-8c8a-badf6d19752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Volume f45bec7c-0dd5-41ed-81a6-973f694d0c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a', 'volume_size': 1} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:52 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" returned: 0 in 0.437s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb2a13-f45c-4d7f-b18a-abf4f5b11015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8493308163b646319d7f38c9dfdfd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:51Z,use_quota=True,user_id='5d0d6bb32c2544a1a5f6cdc737ce8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Creating volume dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ee4f4-11d8-4d8b-a168-fbc5e2c60689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 1073741824 Apr 08 15:57:52 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d476583f-5038-4413-845c-fb6e09eb91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Volume volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf (9d65fc59-05eb-4666-88dc-bd7c21cf7ddf): created successfully Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d476583f-5038-4413-845c-fb6e09eb91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:52 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (2f769f27-ad4e-40ea-890f-cce52285765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-fb86e154-502c-400c-a042-59d4eb066f92 tempest-CreateVolumesFromImageTest-269124107 None] Created volume successfully. Apr 08 15:57:53 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 1073741824" returned: 0 in 0.497s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:53 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 Apr 08 15:57:53 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:53 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" returned: 0 in 0.415s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905014930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebf3a77-7301-43cf-96af-86ead4760efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:53 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd744995-01f0-4f4d-85ca-e0f1b87131f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eccc81f-c79e-43e7-aaa1-5567e29e9fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:53 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe 1073741824 Apr 08 15:57:53 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:53 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Volume volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 (dfeb2a13-f45c-4d7f-b18a-abf4f5b11015): created successfully Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eccc81f-c79e-43e7-aaa1-5567e29e9fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:53 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Flow 'volume_create_manager' (eba05c25-9e0c-4a55-8b19-9bdf84ad030d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-49356827-c304-44f1-936c-2a2878e49940 tempest-CinderUnicodeTest-523927589 None] Created volume successfully. Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Flow 'volume_create_manager' (8ec94871-e459-4e39-8de3-2ef57204b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ccf674-0dbc-4ed6-945f-d62a68b9ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ccf674-0dbc-4ed6-945f-d62a68b9ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-433011753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635e929-4865-4e31-94b2-ee2236985eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8493308163b646319d7f38c9dfdfd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:54Z,use_quota=True,user_id='5d0d6bb32c2544a1a5f6cdc737ce8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd2cb1e-54ec-4ef0-ad23-cdb2f5f7fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd2cb1e-54ec-4ef0-ad23-cdb2f5f7fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbdc3b3-7d84-44e9-98cf-c8c36a48d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbdc3b3-7d84-44e9-98cf-c8c36a48d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3635e929-4865-4e31-94b2-ee2236985eb2', 'volume_name': 'volume-3635e929-4865-4e31-94b2-ee2236985eb2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ac05e-30a0-4fac-9d4f-ef74c128b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ac05e-30a0-4fac-9d4f-ef74c128b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603ab01e-bd4a-4582-b040-403355acf0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Volume 3635e929-4865-4e31-94b2-ee2236985eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3635e929-4865-4e31-94b2-ee2236985eb2', 'volume_size': 1} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:54 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe 1073741824" returned: 0 in 0.554s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:54 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe Apr 08 15:57:54 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:54 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe" returned: 0 in 0.412s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.693s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-442836166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aefb8c-3516-4d28-96ac-8d416d0c5912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Creating volume 73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:54 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b87c73e-7fd9-47af-8781-163fed069d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebf3a77-7301-43cf-96af-86ead4760efe', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 1073741824 Apr 08 15:57:54 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09468d35-9cfc-427c-ae68-f5a1d97cc942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:54 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-cebf3a77-7301-43cf-96af-86ead4760efe (cebf3a77-7301-43cf-96af-86ead4760efe): created successfully Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09468d35-9cfc-427c-ae68-f5a1d97cc942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:54 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (b55febdd-ae94-46aa-a7ea-17c4aba254c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:54 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-73f243b6-90b1-454c-87a1-061094812f64 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:55 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 1073741824" returned: 0 in 0.543s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:55 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:57:55 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:55 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.412s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717010433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c75836f-4b87-439d-a313-da6bc8d9eeb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Creating volume 7c75836f-4b87-439d-a313-da6bc8d9eeb9 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:55 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5561c51e-3127-463c-871a-d0b95120c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73aefb8c-3516-4d28-96ac-8d416d0c5912', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:55 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 1073741824 Apr 08 15:57:55 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e4972-7b12-4b50-9d71-b236f112729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:55 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Volume volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 (73aefb8c-3516-4d28-96ac-8d416d0c5912): created successfully Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e4972-7b12-4b50-9d71-b236f112729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:55 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (db70f3f0-e5a3-44d1-9895-e16c648f63ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:55 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-f72350ae-7aea-4547-bcda-f63f430ce7b3 tempest-VolumeDependencyTests-1902046665 None] Created volume successfully. Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:56 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 1073741824" returned: 0 in 0.534s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:56 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 Apr 08 15:57:56 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:56 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9" returned: 0 in 0.421s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-946256541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cc080f-ec97-45ed-b763-c07408feefb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Creating volume 95cc080f-ec97-45ed-b763-c07408feefb4 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:56 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:56 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 1073741824 Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad56ae-e3d2-4c0d-8bdf-29f06a8d15f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:56 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7546dd98-34b7-4c97-a910-4646ed043847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:56 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Volume volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 (7c75836f-4b87-439d-a313-da6bc8d9eeb9): created successfully Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7546dd98-34b7-4c97-a910-4646ed043847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:56 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (8c2f7b72-2f77-404b-9484-22bd2560a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:56 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-823c7f7e-d2f6-4e32-a060-46913fd1eb63 tempest-CreateVolumesFromImageTest-269124107 None] Created volume successfully. Apr 08 15:57:57 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 1073741824" returned: 0 in 0.457s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:57 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 Apr 08 15:57:57 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:57 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4" returned: 0 in 0.392s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.148s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1048370875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ac32f3-62df-4b93-b705-6c2c859ba4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Creating volume a8ac32f3-62df-4b93-b705-6c2c859ba4ee {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:57 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd607bc-e64c-4caa-aa41-33c4ec98da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cc080f-ec97-45ed-b763-c07408feefb4', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b759-849e-485c-bd6f-4706d22821dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:57 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee 1073741824 Apr 08 15:57:57 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:57 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Volume volume-95cc080f-ec97-45ed-b763-c07408feefb4 (95cc080f-ec97-45ed-b763-c07408feefb4): created successfully Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b759-849e-485c-bd6f-4706d22821dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (b8861ac8-a95b-4a86-878b-6f3bf2051c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:57 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2a7af39f-7539-49dd-b9d1-645eec7d2f78 tempest-CreateVolumesFromImageTest-269124107 None] Created volume successfully. Apr 08 15:57:57 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee 1073741824" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:57 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:57 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee Apr 08 15:57:57 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:58 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" returned: 0 in 0.400s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.857s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125717513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45bec7c-0dd5-41ed-81a6-973f694d0c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da1809b15b64753b7a0f009f0bea4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:52Z,use_quota=True,user_id='d196783b2dbf41acba71790dd3d29c3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Creating volume f45bec7c-0dd5-41ed-81a6-973f694d0c2a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:58 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf162025-3a79-4bcf-805d-8ca4ee9c5714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:58 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a 1073741824 Apr 08 15:57:58 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b9d7a7-df93-4651-bc9b-1fd9da0a6144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:58 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Volume volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee (a8ac32f3-62df-4b93-b705-6c2c859ba4ee): created successfully Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b9d7a7-df93-4651-bc9b-1fd9da0a6144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (e3a1087f-c4c0-4815-8407-e3e9a3348a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:58 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2cdb07c6-81b6-4f41-9e49-1f94cf788bfc tempest-CreateVolumesFromImageTest-269124107 None] Created volume successfully. Apr 08 15:57:58 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a 1073741824" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:58 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:58 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a Apr 08 15:57:58 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:59 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" returned: 0 in 0.408s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.176s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:57:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-433011753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635e929-4865-4e31-94b2-ee2236985eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8493308163b646319d7f38c9dfdfd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:57:54Z,use_quota=True,user_id='5d0d6bb32c2544a1a5f6cdc737ce8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Creating volume 3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:57:59 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b949f-61b6-4586-8c8a-badf6d19752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:59 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 1073741824 Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938bcd2d-e95e-4d29-82e6-9fcb5aab2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:57:59 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:57:59 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Volume volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a (f45bec7c-0dd5-41ed-81a6-973f694d0c2a): created successfully Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938bcd2d-e95e-4d29-82e6-9fcb5aab2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Flow 'volume_create_manager' (a5dd237e-0f93-482b-8327-390f6af96666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:57:59 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-71261f4e-6a5c-4b86-88f9-1c687b1f1934 tempest-CreateVolumesFromImageTest-269124107 None] Created volume successfully. Apr 08 15:57:59 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 1073741824" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:57:59 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:57:59 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 Apr 08 15:57:59 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-f45bec7c-0dd5-41ed-81a6-973f694d0c2a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-f45bec7c-0dd5-41ed-81a6-973f694d0c2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-quobyte-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1472fec-978b-4cae-ba24-4816d311a981]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:00 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a Apr 08 15:58:00 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:00 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2" returned: 0 in 0.423s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.168s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating offline snapshot e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 of volume cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603ab01e-bd4a-4582-b040-403355acf0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3635e929-4865-4e31-94b2-ee2236985eb2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db84aa93-9b17-43e2-9ba7-cdc950200fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513f997-edc4-422b-a799-50767d085fe2]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:00 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Volume volume-3635e929-4865-4e31-94b2-ee2236985eb2 (3635e929-4865-4e31-94b2-ee2236985eb2): created successfully Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db84aa93-9b17-43e2-9ba7-cdc950200fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Flow 'volume_create_manager' (8ec94871-e459-4e39-8de3-2ef57204b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:00 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c87bafa3-dca7-4b85-80a8-0c82e36f0d4e tempest-CinderUnicodeTest-523927589 None] Created volume successfully. Apr 08 15:58:00 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe Apr 08 15:58:00 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:00 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" returned: 0 in 0.534s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:00 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a Apr 08 15:58:00 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:00 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe" returned: 0 in 0.495s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:00 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:00 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 1G Apr 08 15:58:00 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:01 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" returned: 0 in 0.393s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-f45bec7c-0dd5-41ed-81a6-973f694d0c2a" released by "delete_volume" :: held 0.955s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Created reservations ['1a3324e3-0756-43e4-84d4-00f422db7af4', 'e83c90c5-381e-43ce-967b-7c263a5a2888', '7479870d-1217-484a-a33f-e4e6eb344444', '91d83943-ee4a-41b9-b032-fe17e77b87ed'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:01 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:01 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-a8ac32f3-62df-4b93-b705-6c2c859ba4ee-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-a8ac32f3-62df-4b93-b705-6c2c859ba4ee-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-quobyte-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:01 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 1G" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebf3a77-7301-43cf-96af-86ead4760efe -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b000cf3-fd2e-44e2-b7a4-916fd1bd75be]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:01 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebf3a77-7301-43cf-96af-86ead4760efe -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 Apr 08 15:58:01 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:01 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee Apr 08 15:58:01 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:01 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:01 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Deleted volume successfully. Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccdb7249-13f4-4f50-9dda-2a429ba91498 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-f45bec7c-0dd5-41ed-81a6-973f694d0c2a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:01 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebf3a77-7301-43cf-96af-86ead4760efe -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" returned: 0 in 0.440s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:01 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 is being set with open permissions: ugo+rw Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:01 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 Apr 08 15:58:01 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:01 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:01 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:01 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee Apr 08 15:58:01 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" returned: 0 in 0.414s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:02 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" returned: 0 in 0.410s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:02 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info Apr 08 15:58:02 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-a8ac32f3-62df-4b93-b705-6c2c859ba4ee" released by "delete_volume" :: held 0.909s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Created reservations ['534bd3a6-a9e7-46d1-98da-0df51301d304', '353aa0ab-0c7c-4bf8-b069-10aff09cadca', 'bb55a061-e5f3-4a70-932b-4fc9ad57298a', 'ed6b1b61-0c11-4a8f-9bbe-3babb1307111'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:02 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:02 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-95cc080f-ec97-45ed-b763-c07408feefb4-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-95cc080f-ec97-45ed-b763-c07408feefb4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-quobyte-95cc080f-ec97-45ed-b763-c07408feefb4" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-95cc080f-ec97-45ed-b763-c07408feefb4" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0841ca8-3ffc-41c6-8e4c-d893b392c239]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:02 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 Apr 08 15:58:02 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info" returned: 0 in 0.459s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:02 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info is being set with open permissions: ugo+rw Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:02 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info Apr 08 15:58:02 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:02 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Deleted volume successfully. Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7378a00e-3652-4043-8afa-759258742fab tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-a8ac32f3-62df-4b93-b705-6c2c859ba4ee-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:02 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:02 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4 Apr 08 15:58:02 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:02 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:02 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.info" returned: 0 in 0.420s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.809s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.969s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:03 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-31d05381-106d-4c74-8cce-1a22aae98342 tempest-CreateVolumesFromSnapshotTest-491706930 None] Create snapshot completed successfully Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Creating offline snapshot fb914a47-91ab-4303-bb8e-13464608e069 of volume 73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81029672-1690-4ab5-8348-c11394bb3428]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:03 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:03 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:03 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-95cc080f-ec97-45ed-b763-c07408feefb4" returned: 0 in 0.428s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-95cc080f-ec97-45ed-b763-c07408feefb4" released by "delete_volume" :: held 0.945s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Created reservations ['657dd7a0-997b-4871-860e-4e570b2e7fbe', '6b9bdad0-2649-438b-9bba-17561753054c', 'd8c12e98-1f2f-4bfd-b94f-389aaf1edd9b', 'd987f9cf-07c7-47b8-979f-349522f59c61'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:03 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:03 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-7c75836f-4b87-439d-a313-da6bc8d9eeb9-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-7c75836f-4b87-439d-a313-da6bc8d9eeb9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-quobyte-7c75836f-4b87-439d-a313-da6bc8d9eeb9" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-7c75836f-4b87-439d-a313-da6bc8d9eeb9" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[656966be-323a-4aad-98e6-23839146455f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:03 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:03 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 Apr 08 15:58:03 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (827d15fb-4946-4b0a-a1a9-9f5a59ad7f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaf8109-0442-405e-935c-644444bb71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.575s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaf8109-0442-405e-935c-644444bb71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545192266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c9a81a-ec66-4106-8149-92d57ea42f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f881eb3d-cc79-4386-8fd5-9a59110adf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f881eb3d-cc79-4386-8fd5-9a59110adf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c259531-4820-42f3-b0de-92106d4c0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c259531-4820-42f3-b0de-92106d4c0f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c9a81a-ec66-4106-8149-92d57ea42f10', 'volume_name': 'volume-f1c9a81a-ec66-4106-8149-92d57ea42f10', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 1G Apr 08 15:58:03 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd51855-c681-467f-a506-3a55808fd2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd51855-c681-467f-a506-3a55808fd2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e158c7f-9b2b-4f22-8a80-2ab28721efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume f1c9a81a-ec66-4106-8149-92d57ea42f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c9a81a-ec66-4106-8149-92d57ea42f10', 'volume_size': 1} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (7ea2a30a-c05c-4442-afbd-ba6349a34e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc127d0-69e6-4f13-ba24-3d251820012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc127d0-69e6-4f13-ba24-3d251820012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072700926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd3d939-0514-4b76-a457-201b8c6f4c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb2c238-718c-4441-9722-0d59d2c33196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb2c238-718c-4441-9722-0d59d2c33196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca8ecd2-93c4-4630-9f7f-c075b457542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca8ecd2-93c4-4630-9f7f-c075b457542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd3d939-0514-4b76-a457-201b8c6f4c69', 'volume_name': 'volume-9bd3d939-0514-4b76-a457-201b8c6f4c69', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02250cb8-cb2b-4df1-973c-704206d7dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02250cb8-cb2b-4df1-973c-704206d7dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a41224d-10bd-4386-a7ee-3d42dac2e0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:03 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume 9bd3d939-0514-4b76-a457-201b8c6f4c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd3d939-0514-4b76-a457-201b8c6f4c69', 'volume_size': 1} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:03 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.557s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:03 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Deleted volume successfully. Apr 08 15:58:03 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-6aeba8df-c160-4132-a4ba-d71d5da41d3d tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-95cc080f-ec97-45ed-b763-c07408feefb4-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=128,cinder:INSERT=35,cinder:UPDATE=147,cinder:DELETE=15 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=100,cinder:UPDATE=141,cinder:DELETE=11,cinder:INSERT=35 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (47a9ed81-5456-4622-bcfb-69a56232a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3279eb7-d41b-4d17-98e1-4a9cc6db5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3279eb7-d41b-4d17-98e1-4a9cc6db5035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642325539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7317836-821c-48ea-bfe2-82a294f7fdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3152ff95-0735-4f9f-83df-90ff0b43e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3152ff95-0735-4f9f-83df-90ff0b43e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc8639e-2d52-4457-a669-c9dbfb65170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc8639e-2d52-4457-a669-c9dbfb65170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7317836-821c-48ea-bfe2-82a294f7fdfd', 'volume_name': 'volume-f7317836-821c-48ea-bfe2-82a294f7fdfd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7e42b5-472b-4ba3-90ef-8cbf6b5c5614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7e42b5-472b-4ba3-90ef-8cbf6b5c5614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499a2aa-08a1-4fef-ba39-cd8c8a51ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume f7317836-821c-48ea-bfe2-82a294f7fdfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7317836-821c-48ea-bfe2-82a294f7fdfd', 'volume_size': 1} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:04 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9" returned: 0 in 0.673s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:04 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9 Apr 08 15:58:04 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:04 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 1G" returned: 0 in 0.656s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:04 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:04 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (6282492d-2820-4c59-a0d5-b7399cd42c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc76f587-4e63-4f0f-adf3-9bc5bd226cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc76f587-4e63-4f0f-adf3-9bc5bd226cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396450771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df51c92-fdb6-4c02-945e-707c4ceeb47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09caa8ff-efaa-436e-80d0-e61225721222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09caa8ff-efaa-436e-80d0-e61225721222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302e85f-5dbd-4e3f-96da-ca10d559b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302e85f-5dbd-4e3f-96da-ca10d559b126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df51c92-fdb6-4c02-945e-707c4ceeb47d', 'volume_name': 'volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67358a69-8bfc-406f-bcaf-b782a5642c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67358a69-8bfc-406f-bcaf-b782a5642c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26f697-8da0-4e50-b5e3-d2dab35efef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume 6df51c92-fdb6-4c02-945e-707c4ceeb47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d', 'volume_size': 1} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (b2f67681-40f6-4a48-9b14-6f1564360623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6e167e-40ca-4bdd-957e-f53dee7228ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6e167e-40ca-4bdd-957e-f53dee7228ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419970062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e460cfab-6acd-4b67-bdd7-52d6d2516d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:05Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7dc365-c2f8-46c9-963b-4137025e495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7dc365-c2f8-46c9-963b-4137025e495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac7bf49-ef65-42c3-9e04-f940b118e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac7bf49-ef65-42c3-9e04-f940b118e735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e460cfab-6acd-4b67-bdd7-52d6d2516d29', 'volume_name': 'volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36199b8c-97ea-4c54-91e7-8bcf790947ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36199b8c-97ea-4c54-91e7-8bcf790947ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b383b2-7e52-4d36-af28-d298e79f543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:04 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume e460cfab-6acd-4b67-bdd7-52d6d2516d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29', 'volume_size': 1} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:04 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-7c75836f-4b87-439d-a313-da6bc8d9eeb9" returned: 0 in 0.484s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-7c75836f-4b87-439d-a313-da6bc8d9eeb9" released by "delete_volume" :: held 1.178s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Created reservations ['dde29034-7b05-4f59-b6f1-099313166259', '08f067dc-f617-427b-8d92-e69c75ccfc1d', '596dc634-e596-4d33-bdc8-ffe40993c532', '47da6611-de78-4798-9888-1e7d9df4cb94'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:04 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:04 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:04 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.559s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:04 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 is being set with open permissions: ugo+rw Apr 08 15:58:04 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:04 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:04 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:05 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:05 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Deleted volume successfully. Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-87fff35f-f714-499f-b258-538057d0a2b4 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-7c75836f-4b87-439d-a313-da6bc8d9eeb9-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:05 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.402s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:05 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info Apr 08 15:58:05 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "cinder-quobyte-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:05 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info" returned: 0 in 0.426s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:05 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info is being set with open permissions: ugo+rw Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" acquired by "delete_volume" :: waited 0.025s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:05 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info Apr 08 15:58:05 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f1d15-58c8-4d99-afa0-6f9103e1c290]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:05 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:05 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf Apr 08 15:58:05 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:06 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.info" returned: 0 in 0.415s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.601s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Creating offline snapshot a9af1edf-b827-4433-ab75-de88804fd5db of volume 3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[39490f95-c7eb-4f90-9a1f-c4483f28000b]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:06 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-051a6893-bfa4-4305-b7fe-1793dcc93cf0 tempest-VolumeDependencyTests-1902046665 None] Create snapshot completed successfully Apr 08 15:58:06 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" returned: 0 in 0.475s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:06 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf Apr 08 15:58:06 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:06 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 Apr 08 15:58:06 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:06 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (3f850469-0ea5-4d30-add6-ea03e58058df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e763bd-501a-431f-9789-0a6f56411a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2" returned: 0 in 0.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:06 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:06 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db 1G Apr 08 15:58:06 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e763bd-501a-431f-9789-0a6f56411a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1665666229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf2575c-0423-423a-83d5-73fd196b791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb914a47-91ab-4303-bb8e-13464608e069,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:07Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95884ac-7bec-4e44-9f27-0543101f8b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95884ac-7bec-4e44-9f27-0543101f8b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8fc7c3-6e05-4a11-9c49-bb5e94e22463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8fc7c3-6e05-4a11-9c49-bb5e94e22463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bf2575c-0423-423a-83d5-73fd196b791b', 'volume_name': 'volume-0bf2575c-0423-423a-83d5-73fd196b791b', 'volume_size': 1, 'snapshot_id': 'fb914a47-91ab-4303-bb8e-13464608e069'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd92d1ed-9adf-404e-bd8c-8f540fdd0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd92d1ed-9adf-404e-bd8c-8f540fdd0360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b4dedc-8426-41ab-8de9-5996fa85e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:06 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Volume 0bf2575c-0423-423a-83d5-73fd196b791b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bf2575c-0423-423a-83d5-73fd196b791b', 'volume_size': 1, 'snapshot_id': 'fb914a47-91ab-4303-bb8e-13464608e069'} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" returned: 0 in 0.603s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-quobyte-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf" released by "delete_volume" :: held 1.101s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Created reservations ['6123ae35-f0a8-4956-bbc9-4c5793af643f', '32d92bc8-0184-4d94-aa33-9df0242ed934', '2b772098-2705-46da-8792-c9fcbb6a85ff', '49daf8ad-7b17-4633-bbfb-7dc268665cb7'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:06 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:06 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:06 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:07 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db 1G" returned: 0 in 0.525s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3635e929-4865-4e31-94b2-ee2236985eb2 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:07 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3635e929-4865-4e31-94b2-ee2236985eb2 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db Apr 08 15:58:07 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:07 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:07 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Deleted volume successfully. Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-65a22f80-3cc0-4a92-9d65-4444ce0f1189 tempest-CreateVolumesFromImageTest-269124107 None] Lock "cinder-9d65fc59-05eb-4666-88dc-bd7c21cf7ddf-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:07 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3635e929-4865-4e31-94b2-ee2236985eb2 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:07 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db is being set with open permissions: ugo+rw Apr 08 15:58:07 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:07 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db Apr 08 15:58:07 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:08 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db" returned: 0 in 0.453s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:08 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info Apr 08 15:58:08 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:08 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info" returned: 0 in 0.478s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:08 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info is being set with open permissions: ugo+rw Apr 08 15:58:08 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:08 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info Apr 08 15:58:08 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:09 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.info" returned: 0 in 0.523s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.521s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545192266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c9a81a-ec66-4106-8149-92d57ea42f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume f1c9a81a-ec66-4106-8149-92d57ea42f10 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:09 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:09 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-75e351ac-2829-425d-bb57-69a3bcdb0478 tempest-CinderUnicodeTest-523927589 None] Create snapshot completed successfully Apr 08 15:58:09 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 1073741824 Apr 08 15:58:09 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (4dfae396-1d45-4fff-bf96-06131b043545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e79639-8429-439d-9f4e-98464e5c8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e79639-8429-439d-9f4e-98464e5c8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741791487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db2f1e-7058-4777-ab11-fe87cc36de53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:10Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3ebb9-3576-4575-98a4-6164a355dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3ebb9-3576-4575-98a4-6164a355dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191cb2ca-3b37-4ca9-bcf0-7b0fe15bf031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191cb2ca-3b37-4ca9-bcf0-7b0fe15bf031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22db2f1e-7058-4777-ab11-fe87cc36de53', 'volume_name': 'volume-22db2f1e-7058-4777-ab11-fe87cc36de53', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34af2de7-996a-4517-9a52-9d741e874a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34af2de7-996a-4517-9a52-9d741e874a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eeea81-561d-4e68-908b-990ce01526ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:09 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume 22db2f1e-7058-4777-ab11-fe87cc36de53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22db2f1e-7058-4777-ab11-fe87cc36de53', 'volume_size': 1} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:09 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 1073741824" returned: 0 in 0.512s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:09 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 Apr 08 15:58:09 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-a9af1edf-b827-4433-ab75-de88804fd5db-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-a9af1edf-b827-4433-ab75-de88804fd5db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-quobyte-a9af1edf-b827-4433-ab75-de88804fd5db" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-a9af1edf-b827-4433-ab75-de88804fd5db" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Deleting offline snapshot a9af1edf-b827-4433-ab75-de88804fd5db of volume 3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] snapshot_file for this snap is: volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52101c5a-df17-4cac-849a-ac56a3986a5c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:09 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:10 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db Apr 08 15:58:10 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:10 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10" returned: 0 in 0.421s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.253s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072700926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd3d939-0514-4b76-a457-201b8c6f4c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume 9bd3d939-0514-4b76-a457-201b8c6f4c69 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:10 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e158c7f-9b2b-4f22-8a80-2ab28721efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c9a81a-ec66-4106-8149-92d57ea42f10', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:10 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 1073741824 Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58ca61a-2169-4084-9a37-5ace705c2ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:10 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:10 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 (f1c9a81a-ec66-4106-8149-92d57ea42f10): created successfully Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58ca61a-2169-4084-9a37-5ace705c2ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (827d15fb-4946-4b0a-a1a9-9f5a59ad7f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:10 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-edda91aa-3d4b-4841-9fec-8df3c51431a9 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:58:10 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3635e929-4865-4e31-94b2-ee2236985eb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a00cd-1824-4978-b6ef-f3c1cb2748b8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:10 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 Apr 08 15:58:10 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:10 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 1073741824" returned: 0 in 0.511s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:10 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 Apr 08 15:58:10 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:10 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2" returned: 0 in 0.528s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:10 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:10 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db Apr 08 15:58:10 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:11 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69" returned: 0 in 0.406s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.934s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642325539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7317836-821c-48ea-bfe2-82a294f7fdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume f7317836-821c-48ea-bfe2-82a294f7fdfd {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:11 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a41224d-10bd-4386-a7ee-3d42dac2e0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd3d939-0514-4b76-a457-201b8c6f4c69', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02a5f26-d8f8-429b-9fbb-20c35e1111be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:11 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd 1073741824 Apr 08 15:58:11 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:11 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 (9bd3d939-0514-4b76-a457-201b8c6f4c69): created successfully Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02a5f26-d8f8-429b-9fbb-20c35e1111be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (7ea2a30a-c05c-4442-afbd-ba6349a34e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-6286a62b-f28f-48e4-836f-94b704db1598 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:58:11 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:11 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db Apr 08 15:58:11 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:11 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd 1073741824" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:11 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd Apr 08 15:58:11 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:11 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2.a9af1edf-b827-4433-ab75-de88804fd5db" returned: 0 in 0.423s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-a9af1edf-b827-4433-ab75-de88804fd5db" released by "_delete_snapshot" :: held 1.918s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" released by "delete_snapshot" :: held 1.937s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Created reservations ['f1d58cf8-d5fc-4c17-8440-1fb413751efa', 'bffe7302-d309-4c75-929d-f52bba2376e9', '9a8b701b-b5e3-4575-beef-0d6bac6291e2', '390bd9ba-c58b-4ae5-a26d-4c5b79e51921'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:11 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Delete snapshot completed successfully. Apr 08 15:58:11 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ecef2c61-acc1-48cb-9b46-65050198c766 tempest-CinderUnicodeTest-523927589 None] Lock "cinder-a9af1edf-b827-4433-ab75-de88804fd5db-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:12 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd" returned: 0 in 0.431s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.608s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396450771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df51c92-fdb6-4c02-945e-707c4ceeb47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:04Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume 6df51c92-fdb6-4c02-945e-707c4ceeb47d {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:12 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499a2aa-08a1-4fef-ba39-cd8c8a51ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7317836-821c-48ea-bfe2-82a294f7fdfd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6095ff5c-2f7d-4a8e-8419-39c23612abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:12 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d 1073741824 Apr 08 15:58:12 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:12 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-f7317836-821c-48ea-bfe2-82a294f7fdfd (f7317836-821c-48ea-bfe2-82a294f7fdfd): created successfully Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6095ff5c-2f7d-4a8e-8419-39c23612abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (47a9ed81-5456-4622-bcfb-69a56232a0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:12 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-215cea75-bc06-4f1e-9b01-9ec6e5155e04 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:58:12 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d 1073741824" returned: 0 in 0.473s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:12 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:12 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d Apr 08 15:58:12 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:13 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d" returned: 0 in 0.441s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.342s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419970062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e460cfab-6acd-4b67-bdd7-52d6d2516d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0876a43bab9948d99223795f3d737af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:05Z,use_quota=True,user_id='a12e6d0e48b943b789a6b5207e42234e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Creating volume e460cfab-6acd-4b67-bdd7-52d6d2516d29 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:13 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-3635e929-4865-4e31-94b2-ee2236985eb2-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:13 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 1073741824 Apr 08 15:58:13 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26f697-8da0-4e50-b5e3-d2dab35efef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aad8512-270e-4876-9394-2313ecdea768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:13 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d (6df51c92-fdb6-4c02-945e-707c4ceeb47d): created successfully Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aad8512-270e-4876-9394-2313ecdea768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (6282492d-2820-4c59-a0d5-b7399cd42c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:13 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7a9a2241-d400-48ee-88c0-47b9ed6986d4 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-3635e929-4865-4e31-94b2-ee2236985eb2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45516112-d79d-45e0-914e-c25ff632ed3a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:13 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 Apr 08 15:58:13 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:13 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 1073741824" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:13 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 Apr 08 15:58:13 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:13 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2" returned: 0 in 0.495s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:13 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2 Apr 08 15:58:13 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:13 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29" returned: 0 in 0.400s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.174s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069-0bf2575c-0423-423a-83d5-73fd196b791b" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b383b2-7e52-4d36-af28-d298e79f543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:13 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d999f7-a246-4241-a68a-7350a7590b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069-0bf2575c-0423-423a-83d5-73fd196b791b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Creating volume 0bf2575c-0423-423a-83d5-73fd196b791b from snapshot fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:14 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Volume volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 (e460cfab-6acd-4b67-bdd7-52d6d2516d29): created successfully Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d999f7-a246-4241-a68a-7350a7590b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Flow 'volume_create_manager' (b2f67681-40f6-4a48-9b14-6f1564360623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bdefcaac-0173-4f42-b3ca-495e7ac9c993 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created volume successfully. Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] snapshot: fb914a47-91ab-4303-bb8e-13464608e069, volume: 0bf2575c-0423-423a-83d5-73fd196b791b, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d98a6-16b0-460e-955c-de5a1fa359d3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:14 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-3635e929-4865-4e31-94b2-ee2236985eb2" returned: 0 in 0.428s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-3635e929-4865-4e31-94b2-ee2236985eb2" released by "delete_volume" :: held 0.952s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Created reservations ['e821efe5-7bba-4fd1-a0b1-a9abf0ff8ad9', '8906358b-61b1-4af0-8c92-4e7b03d51f0f', '45879fd0-82e6-4490-88e7-d99cceddb788', 'af235b85-ecfa-4d94-b081-f33039ee9353'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:14 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:14 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:14 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:14 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-e460cfab-6acd-4b67-bdd7-52d6d2516d29-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-e460cfab-6acd-4b67-bdd7-52d6d2516d29-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-e460cfab-6acd-4b67-bdd7-52d6d2516d29" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-e460cfab-6acd-4b67-bdd7-52d6d2516d29" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85189b-5296-4847-8255-6b112eeb6fab]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:14 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 Apr 08 15:58:14 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:14 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73aefb8c-3516-4d28-96ac-8d416d0c5912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6d15b8-3c85-424a-a9b5-178d99d16dc6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:14 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.435s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:14 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Deleted volume successfully. Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ae07709a-e450-483d-98e1-e681080a618a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-3635e929-4865-4e31-94b2-ee2236985eb2-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:14 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:14 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:14 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:14 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:14 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29 Apr 08 15:58:14 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:15 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.466s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:15 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b Apr 08 15:58:15 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "cinder-quobyte-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15263b9-91a3-437f-bef7-5c8b1feefce2]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:15 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 Apr 08 15:58:15 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:15 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e460cfab-6acd-4b67-bdd7-52d6d2516d29" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-e460cfab-6acd-4b67-bdd7-52d6d2516d29" released by "delete_volume" :: held 0.955s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['85821143-56ba-4f95-9e06-93a72f6ea2b1', 'c2488f71-4c93-493e-8a55-87f780bc3876', '2345b6a4-ecb8-4b9f-9735-01de932e139c', '8af112e0-51ad-4443-ba87-ec028cd36157'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:15 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:15 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-6df51c92-fdb6-4c02-945e-707c4ceeb47d-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-6df51c92-fdb6-4c02-945e-707c4ceeb47d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-6df51c92-fdb6-4c02-945e-707c4ceeb47d" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-6df51c92-fdb6-4c02-945e-707c4ceeb47d" acquired by "delete_volume" :: waited 0.029s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e15e3-fb30-4456-b3eb-c9c4b530244d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:15 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:16 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d Apr 08 15:58:16 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:16 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" returned: 0 in 1.628s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:16 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:16 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015 Apr 08 15:58:16 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 1.567s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-94541d5e-8ca4-42ad-a9da-3d0937ae1a9e tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-e460cfab-6acd-4b67-bdd7-52d6d2516d29-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:17 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b" returned: 0 in 1.992s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[818df7b1-74af-49d9-a510-4e88993978bd]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:17 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:17 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d" returned: 0 in 1.424s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:17 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d Apr 08 15:58:17 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-quobyte-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015" released by "delete_volume" :: held 2.167s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Created reservations ['a40dab9c-6792-45d3-8d4f-3d60d42831b8', '937cf357-33f1-4ded-be73-9d65234a3d80', '1ca0d28c-bb32-451d-8679-3746db937729', '0a8cabcc-9471-4a05-974e-53a582f22e1e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:17 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:17 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6df51c92-fdb6-4c02-945e-707c4ceeb47d" returned: 0 in 0.404s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-6df51c92-fdb6-4c02-945e-707c4ceeb47d" released by "delete_volume" :: held 1.876s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['2e6f5365-108c-4bfb-89f1-809973e23c9d', 'c176b361-1b0f-41e6-b8c5-653f8ed5ccf5', 'd8a3075f-8bc9-4bd1-b089-7913a5cd12ed', 'f217f489-ca59-4c7b-be93-836c4f0218b6'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:17 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.663s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:58:17 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Converted 1024.00 MB image at 513.72 MB/s Apr 08 15:58:17 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b is being set with open permissions: ugo+rw Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:17 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:17 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b Apr 08 15:58:17 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:17 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:17 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Deleted volume successfully. Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-41962e2e-e1e9-4bc0-930b-09dc0fdeb05a tempest-CinderUnicodeTest-523927589 None] Lock "cinder-dfeb2a13-f45c-4d7f-b18a-abf4f5b11015-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:17 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-f7317836-821c-48ea-bfe2-82a294f7fdfd-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-f7317836-821c-48ea-bfe2-82a294f7fdfd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-f7317836-821c-48ea-bfe2-82a294f7fdfd" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-f7317836-821c-48ea-bfe2-82a294f7fdfd" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e966775-04fc-4b01-b069-12ea975bffac]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:18 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd Apr 08 15:58:18 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:18 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.527s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d7267076-1b9d-4f30-8cd7-8c7b72b85dde tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-6df51c92-fdb6-4c02-945e-707c4ceeb47d-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:18 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b" returned: 0 in 0.556s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" released by "_copy_volume_from_snapshot" :: held 4.245s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069-0bf2575c-0423-423a-83d5-73fd196b791b" released by "_create_volume_from_snapshot" :: held 4.279s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.303s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.560s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741791487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db2f1e-7058-4777-ab11-fe87cc36de53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:10Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume 22db2f1e-7058-4777-ab11-fe87cc36de53 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:18 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b4dedc-8426-41ab-8de9-5996fa85e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf2575c-0423-423a-83d5-73fd196b791b', 'volume_size': 1, 'snapshot_id': 'fb914a47-91ab-4303-bb8e-13464608e069'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:18 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 1073741824 Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b04d0f-3385-46e3-bfbf-0aebfd62e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:18 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:18 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Volume volume-0bf2575c-0423-423a-83d5-73fd196b791b (0bf2575c-0423-423a-83d5-73fd196b791b): created successfully Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b04d0f-3385-46e3-bfbf-0aebfd62e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (3f850469-0ea5-4d30-add6-ea03e58058df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:18 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-3358dfba-b556-465c-b7d9-128a11e5b0d3 tempest-VolumeDependencyTests-1902046665 None] Created volume successfully. Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-fb914a47-91ab-4303-bb8e-13464608e069-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-fb914a47-91ab-4303-bb8e-13464608e069-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Deleting offline snapshot fb914a47-91ab-4303-bb8e-13464608e069 of volume 73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] snapshot_file for this snap is: volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d54aef-bc3a-4214-9934-60f7e6320beb]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:18 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:18 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:18 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd" returned: 0 in 0.617s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:18 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd Apr 08 15:58:18 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:18 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 1073741824" returned: 0 in 0.629s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:18 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:18 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 Apr 08 15:58:18 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:19 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f7317836-821c-48ea-bfe2-82a294f7fdfd" returned: 0 in 0.506s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:19 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.623s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73aefb8c-3516-4d28-96ac-8d416d0c5912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-f7317836-821c-48ea-bfe2-82a294f7fdfd" released by "delete_volume" :: held 1.155s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[776d687e-6b1e-44aa-8f45-a5e1ca6899c3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['efab71bb-ee9f-4fab-bb62-c8c78a5ee19a', '704ddbdd-1b95-41ac-b0a6-4debb9edfa4d', 'b3a4fa0e-9670-4131-977e-d8a3a9166540', '93ad9db9-bdbc-4ade-b5b2-accf9afa6557'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:19 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:19 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:19 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:19 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:19 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53" returned: 0 in 0.535s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eeea81-561d-4e68-908b-990ce01526ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22db2f1e-7058-4777-ab11-fe87cc36de53', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7a501e-0590-4b0d-947a-6d878fbc3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:19 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-22db2f1e-7058-4777-ab11-fe87cc36de53 (22db2f1e-7058-4777-ab11-fe87cc36de53): created successfully Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7a501e-0590-4b0d-947a-6d878fbc3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (4dfae396-1d45-4fff-bf96-06131b043545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c2eefcd3-dd54-4c31-8bc4-f6a8f201b5ab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:19 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.546s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:19 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:19 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:19 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.550s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:19 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:19 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-0a0867db-246d-4b0b-8d0b-8e01ed5cc4ed tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-f7317836-821c-48ea-bfe2-82a294f7fdfd-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-9bd3d939-0514-4b76-a457-201b8c6f4c69-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-9bd3d939-0514-4b76-a457-201b8c6f4c69-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-9bd3d939-0514-4b76-a457-201b8c6f4c69" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-9bd3d939-0514-4b76-a457-201b8c6f4c69" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19913a7-4b9e-4fc7-a41c-142b2102afa3]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:20 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 Apr 08 15:58:20 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:20 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.591s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:20 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069 Apr 08 15:58:20 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (73ddf973-f526-4cd4-96eb-41f70fb9afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da69bfe-43f2-40aa-952e-a10414d25fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da69bfe-43f2-40aa-952e-a10414d25fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368362799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f927a8-f15c-43d6-882a-dc52769e901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef45d58-2fee-4bbd-8ea6-4705e09a332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef45d58-2fee-4bbd-8ea6-4705e09a332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c275d-5873-4817-9be8-6934888acc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c275d-5873-4817-9be8-6934888acc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f927a8-f15c-43d6-882a-dc52769e901e', 'volume_name': 'volume-68f927a8-f15c-43d6-882a-dc52769e901e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c201b59-87bc-4cde-9fc6-aae1dcd41025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c201b59-87bc-4cde-9fc6-aae1dcd41025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfb3d0a-aac8-45fb-a1bd-3f317b1838cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:20 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume 68f927a8-f15c-43d6-882a-dc52769e901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f927a8-f15c-43d6-882a-dc52769e901e', 'volume_size': 1} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368362799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f927a8-f15c-43d6-882a-dc52769e901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume 68f927a8-f15c-43d6-882a-dc52769e901e {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:20 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:20 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e 1073741824 Apr 08 15:58:20 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:20 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (6fdf836e-53d0-487c-8b7c-03173472892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:20 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0072cc-0693-4613-ba4a-62151e99797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0072cc-0693-4613-ba4a-62151e99797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712096289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1199db-f8fa-4308-97a9-4adb88246bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901d2947-199b-4411-b317-a323f07e0947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901d2947-199b-4411-b317-a323f07e0947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83f52ca-23b7-49c3-bb91-b07d85f81fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83f52ca-23b7-49c3-bb91-b07d85f81fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1199db-f8fa-4308-97a9-4adb88246bd3', 'volume_name': 'volume-6d1199db-f8fa-4308-97a9-4adb88246bd3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810b189-b024-48c5-a3b8-55070612ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810b189-b024-48c5-a3b8-55070612ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080fe95d-8556-4838-9a71-1297083a6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume 6d1199db-f8fa-4308-97a9-4adb88246bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1199db-f8fa-4308-97a9-4adb88246bd3', 'volume_size': 1} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69" returned: 0 in 0.765s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:21 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69 Apr 08 15:58:21 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:21 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912.fb914a47-91ab-4303-bb8e-13464608e069" returned: 0 in 0.722s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-fb914a47-91ab-4303-bb8e-13464608e069" released by "_delete_snapshot" :: held 2.555s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" released by "delete_snapshot" :: held 2.583s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (c5b5ac58-16cb-44a4-becd-af3576f670db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066f92f-cd50-4c95-a4df-90edc5e5c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066f92f-cd50-4c95-a4df-90edc5e5c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731658405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b92077-3be9-43a0-851c-3f41a72af0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e2adfe-4e0e-4c98-86e6-66856961500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e2adfe-4e0e-4c98-86e6-66856961500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a78c83-f197-4f99-b0bb-1d907652d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a78c83-f197-4f99-b0bb-1d907652d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b92077-3be9-43a0-851c-3f41a72af0bd', 'volume_name': 'volume-40b92077-3be9-43a0-851c-3f41a72af0bd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84858d4-5a30-441a-aea7-741bb5a00e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84858d4-5a30-441a-aea7-741bb5a00e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66be7ff-0e5e-4b74-a121-733b8d2bd2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume 40b92077-3be9-43a0-851c-3f41a72af0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b92077-3be9-43a0-851c-3f41a72af0bd', 'volume_size': 1} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Created reservations ['96d5742f-4ae9-4801-b05c-1f0c3a834271', '4037d101-9d73-4fda-b50e-a03c39b143b4', 'b8854e13-14be-440e-9615-fcc47e2dc94e', 'abf0574c-4873-4d64-b105-f73fd66bd4a6'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:21 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Delete snapshot completed successfully. Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-229d0a7b-d764-47db-9c33-8d1e49dd3c99 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-fb914a47-91ab-4303-bb8e-13464608e069-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (b1f7db3b-ec35-4ad5-ac8f-dddb329ad5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877df4a2-1505-40a1-8392-110a7348f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877df4a2-1505-40a1-8392-110a7348f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95600329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85990887-b39c-4400-975f-527d3c2d076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e54b1fb-9d21-4c44-8524-84367357689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e54b1fb-9d21-4c44-8524-84367357689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475f35d-cced-4135-8a70-8b2729361f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475f35d-cced-4135-8a70-8b2729361f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85990887-b39c-4400-975f-527d3c2d076c', 'volume_name': 'volume-85990887-b39c-4400-975f-527d3c2d076c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d024756-1e30-401b-a937-ae1ba7441b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d024756-1e30-401b-a937-ae1ba7441b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760391d9-5f59-4908-a377-e7ee8af85fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume 85990887-b39c-4400-975f-527d3c2d076c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85990887-b39c-4400-975f-527d3c2d076c', 'volume_size': 1} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_service.periodic_task [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:21 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:21 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-73aefb8c-3516-4d28-96ac-8d416d0c5912-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-73aefb8c-3516-4d28-96ac-8d416d0c5912-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:21 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" acquired by "delete_volume" :: waited 0.042s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:21 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dab6b2-9d5f-479e-a9a8-a024ac32072c]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-9bd3d939-0514-4b76-a457-201b8c6f4c69" returned: 0 in 0.838s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (e08c5c31-3c4d-4b3a-8889-7594af39d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a32f65-edf2-435b-b89d-308ed6bf62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e 1073741824" returned: 0 in 1.093s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a32f65-edf2-435b-b89d-308ed6bf62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286916037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69d5ee0-d426-4dec-bca4-fd4e91cdadd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:22Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282dbfe-6e55-4505-96c0-204f33f1269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282dbfe-6e55-4505-96c0-204f33f1269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb70699-3495-4272-a4ee-9390009c666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb70699-3495-4272-a4ee-9390009c666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69d5ee0-d426-4dec-bca4-fd4e91cdadd2', 'volume_name': 'volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b6f93b-bdac-4638-98de-d5c9fc5193d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b6f93b-bdac-4638-98de-d5c9fc5193d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637af37-917d-45e8-8b10-5ae457cb70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:21 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume e69d5ee0-d426-4dec-bca4-fd4e91cdadd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2', 'volume_size': 1} Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:21 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:21 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:21 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-9bd3d939-0514-4b76-a457-201b8c6f4c69" released by "delete_volume" :: held 1.718s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['f621d561-cb23-4002-a8e5-123f4c9ad7fb', 'cffd13a2-a3ef-4315-9047-b45728fe28bb', 'a59eb535-ff79-47c1-821a-e5508471d1ec', '143cfa1d-aa5b-4051-8478-67e1a9086495'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:22 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e Apr 08 15:58:22 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:22 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:22 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:22 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.686s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-a73e5719-b069-4fc7-84b5-8dedae3c7c25 None None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-f1c9a81a-ec66-4106-8149-92d57ea42f10-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-f1c9a81a-ec66-4106-8149-92d57ea42f10-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:22 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.645s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-f1c9a81a-ec66-4106-8149-92d57ea42f10" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:22 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912 Apr 08 15:58:22 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-f1c9a81a-ec66-4106-8149-92d57ea42f10" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d80124-137f-48d5-964e-32aa3f76fefb]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:22 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.523s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-8eb7bb92-e540-419d-b8ff-fd4845eb2366 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-9bd3d939-0514-4b76-a457-201b8c6f4c69-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:22 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e" returned: 0 in 0.645s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712096289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1199db-f8fa-4308-97a9-4adb88246bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume 6d1199db-f8fa-4308-97a9-4adb88246bd3 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:22 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:22 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 Apr 08 15:58:22 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfb3d0a-aac8-45fb-a1bd-3f317b1838cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f927a8-f15c-43d6-882a-dc52769e901e', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c384ee6f-3e45-47fa-bb88-9083710d3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:22 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 1073741824 Apr 08 15:58:22 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:22 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-68f927a8-f15c-43d6-882a-dc52769e901e (68f927a8-f15c-43d6-882a-dc52769e901e): created successfully Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c384ee6f-3e45-47fa-bb88-9083710d3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:22 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (73ddf973-f526-4cd4-96eb-41f70fb9afc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:22 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a3d8d98c-318b-464c-8b30-01a8c3259029 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:23 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-73aefb8c-3516-4d28-96ac-8d416d0c5912" returned: 0 in 0.587s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-73aefb8c-3516-4d28-96ac-8d416d0c5912" released by "delete_volume" :: held 1.276s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Created reservations ['305a026d-9e56-474b-9dc2-dce8a4f1b647', '0fe3e35a-cc3a-41b4-a6aa-51ab36bb31e7', '3a97cfd3-601a-4b05-841a-8bf768280af5', '37ba4a55-d58a-4b39-b499-0d3a2498e792'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:23 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10" returned: 0 in 0.615s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:23 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10 Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:23 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:23 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:23 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:23 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 1073741824" returned: 0 in 0.703s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:23 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 Apr 08 15:58:23 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:23 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.644s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:23 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Deleted volume successfully. Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5954ae29-9516-44c6-9cff-697cd7f727fd tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-73aefb8c-3516-4d28-96ac-8d416d0c5912-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:23 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-f1c9a81a-ec66-4106-8149-92d57ea42f10" returned: 0 in 0.717s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-f1c9a81a-ec66-4106-8149-92d57ea42f10" released by "delete_volume" :: held 1.363s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:23 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['d1db93da-a92b-4551-8fe0-206725a17467', '09a84401-8405-4673-b1c5-645da38d424a', '0db036c2-0060-47c4-b09d-292b63bc2003', 'ac115102-c1d3-49e6-b225-f19f12e26ac3'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:23 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3" returned: 0 in 0.614s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.727s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731658405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b92077-3be9-43a0-851c-3f41a72af0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume 40b92077-3be9-43a0-851c-3f41a72af0bd {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:24 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080fe95d-8556-4838-9a71-1297083a6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1199db-f8fa-4308-97a9-4adb88246bd3', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd 1073741824 Apr 08 15:58:24 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ebaa7-a8f7-4c93-a30f-1d6f97f500db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 (6d1199db-f8fa-4308-97a9-4adb88246bd3): created successfully Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ebaa7-a8f7-4c93-a30f-1d6f97f500db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (6fdf836e-53d0-487c-8b7c-03173472892b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-57aec58c-c682-4f93-9fb6-7be901a60bab tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:24 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:24 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (0a894077-42d6-40a1-a632-ac2f648ee390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a16b5-6612-4193-b03e-627b4c96c8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a16b5-6612-4193-b03e-627b4c96c8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-820005933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663013bf-41a8-4bac-b2ae-82b41f277d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:24Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53038ccc-6911-4d4e-872e-2248f6cef562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53038ccc-6911-4d4e-872e-2248f6cef562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c93f729-c1cf-4249-ae6b-6f0a32026494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c93f729-c1cf-4249-ae6b-6f0a32026494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663013bf-41a8-4bac-b2ae-82b41f277d8a', 'volume_name': 'volume-663013bf-41a8-4bac-b2ae-82b41f277d8a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e4b2d1-1194-4bd6-86d7-e5a539b71f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e4b2d1-1194-4bd6-86d7-e5a539b71f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d55697-1fda-4fd0-aedb-c6a98b3c6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:24 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Volume 663013bf-41a8-4bac-b2ae-82b41f277d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663013bf-41a8-4bac-b2ae-82b41f277d8a', 'volume_size': 1} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:24 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd 1073741824" returned: 0 in 0.646s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:24 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.539s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:24 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d70e9c60-1f85-4305-a9df-121f7457d005 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-f1c9a81a-ec66-4106-8149-92d57ea42f10-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:24 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd Apr 08 15:58:24 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleting offline snapshot e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 of volume cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] snapshot_file for this snap is: volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76668b-5c3d-4819-b823-1fdedf95e519]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:24 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:24 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 Apr 08 15:58:24 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:25 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd" returned: 0 in 0.469s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.613s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95600329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85990887-b39c-4400-975f-527d3c2d076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:21Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume 85990887-b39c-4400-975f-527d3c2d076c {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:25 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66be7ff-0e5e-4b74-a121-733b8d2bd2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b92077-3be9-43a0-851c-3f41a72af0bd', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67a308c-8ef4-4490-a7d4-11442188c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:25 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c 1073741824 Apr 08 15:58:25 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:25 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-40b92077-3be9-43a0-851c-3f41a72af0bd (40b92077-3be9-43a0-851c-3f41a72af0bd): created successfully Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67a308c-8ef4-4490-a7d4-11442188c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (c5b5ac58-16cb-44a4-becd-af3576f670db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:25 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-e8bc0417-10d3-424f-b800-3027da95ad5d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:25 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" returned: 0 in 0.586s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cebf3a77-7301-43cf-96af-86ead4760efe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[631aecc0-bf13-4c3a-acd6-6052b22d9025]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:25 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe Apr 08 15:58:25 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:25 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c 1073741824" returned: 0 in 0.517s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:25 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c Apr 08 15:58:25 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:25 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe" returned: 0 in 0.563s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:25 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:25 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 Apr 08 15:58:25 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:26 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c" returned: 0 in 0.509s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.311s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286916037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69d5ee0-d426-4dec-bca4-fd4e91cdadd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da4fdebae8c43a28e445f0ba0c5518b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:22Z,use_quota=True,user_id='6c813e7438024ee5981077f69b29384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Creating volume e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:26 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:26 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 1073741824 Apr 08 15:58:26 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760391d9-5f59-4908-a377-e7ee8af85fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85990887-b39c-4400-975f-527d3c2d076c', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973f662b-1eae-4801-a477-3c6c87004f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:26 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-85990887-b39c-4400-975f-527d3c2d076c (85990887-b39c-4400-975f-527d3c2d076c): created successfully Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973f662b-1eae-4801-a477-3c6c87004f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (b1f7db3b-ec35-4ad5-ac8f-dddb329ad5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:26 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-09581137-c022-4704-b4ba-ae56035695aa tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:26 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" returned: 0 in 0.533s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:26 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2 Apr 08 15:58:26 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:26 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 1073741824" returned: 0 in 0.621s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:26 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:26 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 Apr 08 15:58:26 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:27 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe.e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" returned: 0 in 0.553s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2" released by "_delete_snapshot" :: held 2.306s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" released by "delete_snapshot" :: held 2.323s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['bdd80536-1773-49b4-9e60-53b780befa23', '91748e12-58b8-4f28-ba8f-8ea9e7ebbac4', 'e6a9f688-09a7-4795-84eb-324994858868', '768fc56e-4622-420f-ad08-02bd3590186c'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Delete snapshot completed successfully. Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d179c5e7-1cee-4dd9-b9ca-4478f3c29e41 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-e63e69ea-f4ca-404a-8cc3-1c49f8d672c2-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:27 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" returned: 0 in 0.514s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-820005933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663013bf-41a8-4bac-b2ae-82b41f277d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:24Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Creating volume 663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:27 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637af37-917d-45e8-8b10-5ae457cb70aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:27 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a 1073741824 Apr 08 15:58:27 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3ff6f-b385-4d7c-860f-d123e937d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:27 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Volume volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 (e69d5ee0-d426-4dec-bca4-fd4e91cdadd2): created successfully Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3ff6f-b385-4d7c-860f-d123e937d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Flow 'volume_create_manager' (e08c5c31-3c4d-4b3a-8889-7594af39d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:27 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-cdf062cc-6b95-4afc-8b91-dca269fd7849 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created volume successfully. Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-cebf3a77-7301-43cf-96af-86ead4760efe-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-cebf3a77-7301-43cf-96af-86ead4760efe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" acquired by "delete_volume" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1252d2-f300-46b1-b788-4c8005ee028a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:27 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:28 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe Apr 08 15:58:28 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:28 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a 1073741824" returned: 0 in 0.559s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:28 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:28 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:28 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe" returned: 0 in 0.552s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:28 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe Apr 08 15:58:28 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:28 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.530s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d55697-1fda-4fd0-aedb-c6a98b3c6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663013bf-41a8-4bac-b2ae-82b41f277d8a', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f836c43-b72a-4f2a-a2d1-4f1932efd7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:28 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Volume volume-663013bf-41a8-4bac-b2ae-82b41f277d8a (663013bf-41a8-4bac-b2ae-82b41f277d8a): created successfully Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f836c43-b72a-4f2a-a2d1-4f1932efd7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (0a894077-42d6-40a1-a632-ac2f648ee390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" acquired by "delete_volume" :: waited 0.020s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:28 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-50e5036f-f1f6-43bf-b0f6-6933dca9e8d1 tempest-VolumeDependencyTests-1902046665 None] Created volume successfully. Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd33bf-9202-4c79-8002-0e822160a4a9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:28 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:28 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 Apr 08 15:58:28 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:29 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-cebf3a77-7301-43cf-96af-86ead4760efe" returned: 0 in 0.573s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-quobyte-cebf3a77-7301-43cf-96af-86ead4760efe" released by "delete_volume" :: held 1.160s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Created reservations ['bf8bea72-172c-4032-9122-a359179384ee', '99e234f2-ab03-432f-af65-3e46276004ef', 'c1264e8b-3f85-4711-a659-880fa615b4ad', 'c2e7b84a-e64d-4268-bbf0-24120376106a'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:29 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:29 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:29 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" returned: 0 in 0.654s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:29 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2 Apr 08 15:58:29 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:29 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.500s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:29 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Deleted volume successfully. Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-d759a452-5d19-4b65-a188-892fc79c4537 tempest-CreateVolumesFromSnapshotTest-491706930 None] Lock "cinder-cebf3a77-7301-43cf-96af-86ead4760efe-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:29 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" returned: 0 in 0.496s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2" released by "delete_volume" :: held 1.175s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['bd299658-c2a7-48ef-aeb6-bdfb1ca32def', '338323b7-6266-467e-8d6d-fc443778eaf1', 'b467dbc6-e3a1-4f26-9a22-0f8b6f8ade74', '8b87a0ef-607d-40d6-ae56-837189e27c3e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:29 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:29 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:29 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (574f347a-f2d3-44ad-b433-b1f161bf7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fd6f03-d452-4c96-8288-a640e64e13d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fd6f03-d452-4c96-8288-a640e64e13d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1855602656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad5750c-778b-4fcf-a88a-ad4a33fc4a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f10fa33effd4337bafed1facec22b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=663013bf-41a8-4bac-b2ae-82b41f277d8a,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:30Z,use_quota=True,user_id='283f6ee6d19e459889591151a9a30e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85ee73e-3546-4d04-a709-a4244ee6683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85ee73e-3546-4d04-a709-a4244ee6683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a8917b-be09-46fd-9b33-62452172f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a8917b-be09-46fd-9b33-62452172f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2ad5750c-778b-4fcf-a88a-ad4a33fc4a88', 'volume_name': 'volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88', 'volume_size': 1, 'source_volid': '663013bf-41a8-4bac-b2ae-82b41f277d8a', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c6ad1f-4394-4037-b253-a669a0633da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c6ad1f-4394-4037-b253-a669a0633da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1685e63-2bfd-43b5-93a5-01a201e23353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:30 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Volume 2ad5750c-778b-4fcf-a88a-ad4a33fc4a88: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88', 'volume_size': 1, 'source_volid': '663013bf-41a8-4bac-b2ae-82b41f277d8a', 'source_volstatus': 'available'} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:30 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Cloning volume 663013bf-41a8-4bac-b2ae-82b41f277d8a to volume 2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Creating offline snapshot c8805175-ea90-4524-9ddd-fe4730c1d0b4 of volume 663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e9e08-44b9-4da3-8ec1-fd1840df42ef]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:30 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:30 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:30 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.503s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:30 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-ccc3c527-6fa1-44d1-95e4-76b8e0d6c302 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-e69d5ee0-d426-4dec-bca4-fd4e91cdadd2-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:30 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.601s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-85990887-b39c-4400-975f-527d3c2d076c-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-85990887-b39c-4400-975f-527d3c2d076c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:30 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 1G Apr 08 15:58:30 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-85990887-b39c-4400-975f-527d3c2d076c" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-85990887-b39c-4400-975f-527d3c2d076c" acquired by "delete_volume" :: waited 0.017s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[481676c2-c983-4dd8-94a5-cf4cd25eb306]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:30 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:30 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c Apr 08 15:58:30 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:31 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 1G" returned: 0 in 0.595s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663013bf-41a8-4bac-b2ae-82b41f277d8a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:31 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663013bf-41a8-4bac-b2ae-82b41f277d8a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:31 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:31 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c" returned: 0 in 0.615s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:31 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c Apr 08 15:58:31 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:31 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663013bf-41a8-4bac-b2ae-82b41f277d8a -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:31 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 is being set with open permissions: ugo+rw Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:31 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:31 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:31 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-85990887-b39c-4400-975f-527d3c2d076c" returned: 0 in 0.455s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-85990887-b39c-4400-975f-527d3c2d076c" released by "delete_volume" :: held 1.097s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:31 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['61eabdb9-de58-4c3b-9003-29d00f88901a', '5259d5b8-9267-4ebb-a31c-77bd4e09012e', 'ca2a30ec-2205-42c9-9b90-e476fa30f840', '8630f94f-86b4-43aa-bdf8-01ab0db1d851'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:32 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:32 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:32 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.451s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:32 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info Apr 08 15:58:32 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:32 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.448s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:32 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-9163ef62-fa72-42d4-8fe7-b8f50aba3309 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-85990887-b39c-4400-975f-527d3c2d076c-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:32 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info" returned: 0 in 0.471s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:32 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info is being set with open permissions: ugo+rw Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:32 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info Apr 08 15:58:32 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-40b92077-3be9-43a0-851c-3f41a72af0bd-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:32 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-40b92077-3be9-43a0-851c-3f41a72af0bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-40b92077-3be9-43a0-851c-3f41a72af0bd" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-40b92077-3be9-43a0-851c-3f41a72af0bd" acquired by "delete_volume" :: waited 0.014s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb218df-87bc-4b8a-88f2-27fedc90c62d]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:33 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd Apr 08 15:58:33 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:33 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.info" returned: 0 in 0.485s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] snapshot: c8805175-ea90-4524-9ddd-fe4730c1d0b4, volume: 2ad5750c-778b-4fcf-a88a-ad4a33fc4a88, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef93e1-aa62-42b5-8fae-0ec8db40dcd8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:33 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:33 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:33 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd" returned: 0 in 0.533s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:33 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd Apr 08 15:58:33 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:33 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.588s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663013bf-41a8-4bac-b2ae-82b41f277d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b7330-5921-4735-ad88-de7d9c0d2d1a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:33 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:33 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:33 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:34 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-40b92077-3be9-43a0-851c-3f41a72af0bd" returned: 0 in 0.510s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-40b92077-3be9-43a0-851c-3f41a72af0bd" released by "delete_volume" :: held 1.070s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['76f41322-f47c-4cdd-a5d0-32cac23df27d', 'db7a9327-1095-47fc-9c6c-fe1cccef578c', '80a099a0-d5c1-4bd7-8d77-facfa9ad06b2', 'afa38a7e-8765-4a38-9a0e-937e6c0a6b0b'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:34 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:34 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:34 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.635s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:34 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 Apr 08 15:58:34 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:34 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.529s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:34 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:34 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-c2604b18-dca3-42af-b1e1-cf7c36ce6ab2 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-40b92077-3be9-43a0-851c-3f41a72af0bd-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-6d1199db-f8fa-4308-97a9-4adb88246bd3-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-6d1199db-f8fa-4308-97a9-4adb88246bd3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-6d1199db-f8fa-4308-97a9-4adb88246bd3" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-6d1199db-f8fa-4308-97a9-4adb88246bd3" acquired by "delete_volume" :: waited 0.016s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[31954c4f-d869-4d31-bb78-9c1803fdeee1]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:35 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:35 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 Apr 08 15:58:35 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:36 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3" returned: 0 in 1.299s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:36 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3 Apr 08 15:58:36 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:36 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" returned: 0 in 2.302s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:36 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70da5a-cd56-4852-911d-d2256a53da4a]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:36 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:36 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:36 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:37 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-6d1199db-f8fa-4308-97a9-4adb88246bd3" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-6d1199db-f8fa-4308-97a9-4adb88246bd3" released by "delete_volume" :: held 1.790s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['b9e8bac5-b0c5-4a61-8619-6605dd54fd03', '9c3591b9-c4e1-4e46-be4d-3a635100fc4d', '7e95c261-1576-4677-9e6b-781c4d85dd8f', '52777dc3-eab7-407a-9ac4-bfce660adca3'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:37 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:37 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:37 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.690s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:58:37 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Converted 1024.00 MB image at 444.51 MB/s Apr 08 15:58:37 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 is being set with open permissions: ugo+rw Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:37 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 Apr 08 15:58:37 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-68f927a8-f15c-43d6-882a-dc52769e901e-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-68f927a8-f15c-43d6-882a-dc52769e901e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-68f927a8-f15c-43d6-882a-dc52769e901e" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-68f927a8-f15c-43d6-882a-dc52769e901e" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5116ac4-1631-4ec2-8852-c0ec05ad30a8]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:37 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e Apr 08 15:58:37 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:37 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.480s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:37 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-bbf52d3a-5583-4381-8b57-d8e29f83cb1b tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-6d1199db-f8fa-4308-97a9-4adb88246bd3-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:37 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:37 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" returned: 0 in 0.476s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" released by "_copy_volume_from_snapshot" :: held 4.745s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-c8805175-ea90-4524-9ddd-fe4730c1d0b4" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-c8805175-ea90-4524-9ddd-fe4730c1d0b4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Deleting offline snapshot c8805175-ea90-4524-9ddd-fe4730c1d0b4 of volume 663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] snapshot_file for this snap is: volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5cb94-516a-40d3-a17c-4b51f9036119]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Flow 'volume_create_manager' (54455f77-4b22-4ea4-8ddb-1e80bdd917b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f67df-4394-4364-b721-e2b4fcb6bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f67df-4394-4364-b721-e2b4fcb6bda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1824784472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a10a98-5f28-40a4-9d0b-938da037de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cf21f7e4364cd6b26fdd39c6007ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:38Z,use_quota=True,user_id='424360490e564bb18f345d80cce97761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:38 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:38 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbd51f3-e0c4-4b0b-b604-cd3bd3584af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbd51f3-e0c4-4b0b-b604-cd3bd3584af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab65c1db-798b-4278-8755-cf17bffdb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab65c1db-798b-4278-8755-cf17bffdb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a10a98-5f28-40a4-9d0b-938da037de88', 'volume_name': 'volume-e2a10a98-5f28-40a4-9d0b-938da037de88', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead98f89-647a-433f-b636-889b73dbf828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead98f89-647a-433f-b636-889b73dbf828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabf7a65-a1b1-4bc2-acb0-e4815d6cb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:38 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Volume e2a10a98-5f28-40a4-9d0b-938da037de88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a10a98-5f28-40a4-9d0b-938da037de88', 'volume_size': 1} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:38 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e" returned: 0 in 0.518s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:38 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e Apr 08 15:58:38 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:38 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663013bf-41a8-4bac-b2ae-82b41f277d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9b4e4-3c5e-4f38-8d15-0f8a74030af0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:38 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:38 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:38 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-68f927a8-f15c-43d6-882a-dc52769e901e" returned: 0 in 0.408s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-68f927a8-f15c-43d6-882a-dc52769e901e" released by "delete_volume" :: held 0.960s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['edb0d1ee-4adc-4f85-a7ff-c89cda56111e', '259fa3c1-91bd-4f3f-a260-4c07ce69f3e5', 'c9555716-a4a8-45cc-b50e-ed1cb994055e', '56ba482d-1031-4b0c-aae9-9d1c9d4044ce'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:38 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:38 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-22db2f1e-7058-4777-ab11-fe87cc36de53-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-22db2f1e-7058-4777-ab11-fe87cc36de53-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "cinder-quobyte-22db2f1e-7058-4777-ab11-fe87cc36de53" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-22db2f1e-7058-4777-ab11-fe87cc36de53" acquired by "delete_volume" :: waited 0.018s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111a1f0-e9b4-49f8-8daa-f65b2191c8f9]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:38 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:38 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 Apr 08 15:58:38 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:39 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:39 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.440s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:39 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4b00abc8-af3f-4120-beb6-51a4f9e8efd0 tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-68f927a8-f15c-43d6-882a-dc52769e901e-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:39 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53" returned: 0 in 0.470s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:39 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53 Apr 08 15:58:39 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.450s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:39 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4 Apr 08 15:58:39 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-22db2f1e-7058-4777-ab11-fe87cc36de53" returned: 0 in 0.398s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-quobyte-22db2f1e-7058-4777-ab11-fe87cc36de53" released by "delete_volume" :: held 0.891s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Created reservations ['928c86c3-f7f5-4721-9416-977e904ae737', '5016ab84-03a9-4ddf-93b4-1a092528df03', 'a928990f-6eb5-4e2d-8b93-4482104c741a', '6d45c969-495f-4346-8101-8f7d6cadc826'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:39 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:39 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a.c8805175-ea90-4524-9ddd-fe4730c1d0b4" returned: 0 in 0.422s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-c8805175-ea90-4524-9ddd-fe4730c1d0b4" released by "_delete_snapshot" :: held 1.908s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.871s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1824784472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a10a98-5f28-40a4-9d0b-938da037de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cf21f7e4364cd6b26fdd39c6007ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:38Z,use_quota=True,user_id='424360490e564bb18f345d80cce97761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)}" {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Creating volume e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:39 devstack cinder-volume[82216]: INFO cinder.volume.drivers.remotefs [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] casted to osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 1073741824 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1685e63-2bfd-43b5-93a5-01a201e23353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88', 'volume_size': 1, 'source_volid': '663013bf-41a8-4bac-b2ae-82b41f277d8a', 'source_volstatus': 'available'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:39 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 1073741824 Apr 08 15:58:39 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:39 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcae444-5747-454e-9793-10c99d99098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:40 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Volume volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 (2ad5750c-778b-4fcf-a88a-ad4a33fc4a88): created successfully Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcae444-5747-454e-9793-10c99d99098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Flow 'volume_create_manager' (574f347a-f2d3-44ad-b433-b1f161bf7870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:40 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-a710800c-b38d-4b7f-a6d3-cb3ef230923a tempest-VolumeDependencyTests-1902046665 None] Created volume successfully. Apr 08 15:58:40 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.488s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:40 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Deleted volume successfully. Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7d46f62a-659a-4f59-82cc-91e413fb502d tempest-CreateVolumesFromSourceVolumeTest-2042981882 None] Lock "cinder-22db2f1e-7058-4777-ab11-fe87cc36de53-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:40 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 1073741824" returned: 0 in 0.586s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:40 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:40 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-663013bf-41a8-4bac-b2ae-82b41f277d8a-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-663013bf-41a8-4bac-b2ae-82b41f277d8a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-663013bf-41a8-4bac-b2ae-82b41f277d8a" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-663013bf-41a8-4bac-b2ae-82b41f277d8a" acquired by "delete_volume" :: waited 0.019s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19231c23-fcef-4188-8aae-d7a8465ebfa7]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:40 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:40 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:40 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:41 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'} {{(pid=82216) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabf7a65-a1b1-4bc2-acb0-e4815d6cb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a10a98-5f28-40a4-9d0b-938da037de88', 'volume_size': 1}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94008845-9c02-4aad-ab29-cf49055323f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:41 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Volume volume-e2a10a98-5f28-40a4-9d0b-938da037de88 (e2a10a98-5f28-40a4-9d0b-938da037de88): created successfully Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94008845-9c02-4aad-ab29-cf49055323f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Flow 'volume_create_manager' (54455f77-4b22-4ea4-8ddb-1e80bdd917b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:41 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-2dfad0ec-9afd-4e61-8309-5430ed4ffa07 tempest-SnapshotDependencyTests-1529532451 None] Created volume successfully. Apr 08 15:58:41 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.487s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:41 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a Apr 08 15:58:41 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Creating offline snapshot fd6d8987-7dae-42b5-8fbb-d196c90c207d of volume e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc25511-9928-4d80-a5aa-5f97999e56d5]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:41 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:41 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:41 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-663013bf-41a8-4bac-b2ae-82b41f277d8a" returned: 0 in 0.414s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-663013bf-41a8-4bac-b2ae-82b41f277d8a" released by "delete_volume" :: held 0.933s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Created reservations ['e8571f0d-4641-4ffe-b788-902f2b3b89ef', 'e96451fb-7e74-49d4-b958-8eaca3d68676', '00ce3a97-8553-4724-86b7-55b52cf6e54c', 'ea4d2edb-5747-440d-a5ef-6101de0357d2'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:41 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:41 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" acquired by "delete_volume" :: waited 0.015s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7625f5-e1b0-4e0d-87ad-5e55fadb98b4]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:41 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 Apr 08 15:58:41 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:41 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.505s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:41 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d 1G {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:41 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d 1G Apr 08 15:58:41 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:42 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.429s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:42 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Deleted volume successfully. Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-7b003779-592b-4086-9181-b510d28d9df6 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-663013bf-41a8-4bac-b2ae-82b41f277d8a-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:42 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" returned: 0 in 0.489s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:42 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88 Apr 08 15:58:42 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:42 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d 1G" returned: 0 in 0.504s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a10a98-5f28-40a4-9d0b-938da037de88 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:42 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a10a98-5f28-40a4-9d0b-938da037de88 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:42 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:42 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" returned: 0 in 0.430s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88" released by "delete_volume" :: held 0.939s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Created reservations ['dc167a19-5a54-40fe-9cbc-ea65ba710f4c', 'cf99d576-343c-4466-a85d-77f052e0a735', '5e1fece8-650b-4057-944a-389f733eb499', 'a4bc0785-210a-4532-aa11-cda51dbfc32e'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:42 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:42 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:42 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a10a98-5f28-40a4-9d0b-938da037de88 -F qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.472s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:42 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d is being set with open permissions: ugo+rw Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:42 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:42 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-0bf2575c-0423-423a-83d5-73fd196b791b-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:42 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-0bf2575c-0423-423a-83d5-73fd196b791b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" acquired by "delete_volume" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ffd8bb-416b-47c7-972e-b6724a03b5d0]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:43 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b Apr 08 15:58:43 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:43 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:43 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Deleted volume successfully. Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-22c01fe0-9b7e-44e8-bac2-7c60e18cd130 tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-2ad5750c-778b-4fcf-a88a-ad4a33fc4a88-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:43 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:43 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info Apr 08 15:58:43 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:43 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b" returned: 0 in 0.490s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:43 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b Apr 08 15:58:43 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:43 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info" returned: 0 in 0.416s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:43 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info is being set with open permissions: ugo+rw Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:43 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info Apr 08 15:58:43 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:43 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-0bf2575c-0423-423a-83d5-73fd196b791b" returned: 0 in 0.424s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-quobyte-0bf2575c-0423-423a-83d5-73fd196b791b" released by "delete_volume" :: held 0.937s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:43 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Created reservations ['c358bfb7-03e0-48f0-99b1-007704c8f55f', 'e04cd022-c887-4ee4-b4ed-88e349f85283', 'f8b4ada5-998c-4712-bdef-1f0d496869a5', '548e1863-124d-4855-9951-efa9d7c43d15'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:44 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:44 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:44 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.info" returned: 0 in 0.442s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-066c58b1-89f3-4575-8e78-aff13c26b016 tempest-SnapshotDependencyTests-1529532451 None] Create snapshot completed successfully Apr 08 15:58:44 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:44 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Deleted volume successfully. Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-b91d53bf-27b9-4992-9086-65387259b3eb tempest-VolumeDependencyTests-1902046665 None] Lock "cinder-0bf2575c-0423-423a-83d5-73fd196b791b-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82216) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Flow 'volume_create_manager' (7e3dc412-a46b-472e-b512-a6c2a80743b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9c610e-f836-464f-b409-2f6a4e1410a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9c610e-f836-464f-b409-2f6a4e1410a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T13:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1628cc42-ba79-4d3f-ba08-654e6d242abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cf21f7e4364cd6b26fdd39c6007ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T13:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd6d8987-7dae-42b5-8fbb-d196c90c207d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T13:58:45Z,use_quota=True,user_id='424360490e564bb18f345d80cce97761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68df3811-5109-47ad-b481-9a1c4494c306),volume_type_id=68df3811-5109-47ad-b481-9a1c4494c306)' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f912a2b-4307-4419-9316-f7523ecbfa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f912a2b-4307-4419-9316-f7523ecbfa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d708485-e532-46b2-8126-a0f55671f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d708485-e532-46b2-8126-a0f55671f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1628cc42-ba79-4d3f-ba08-654e6d242abf', 'volume_name': 'volume-1628cc42-ba79-4d3f-ba08-654e6d242abf', 'volume_size': 1, 'snapshot_id': 'fd6d8987-7dae-42b5-8fbb-d196c90c207d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d3012-8d32-4506-842d-481662e31a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2d3012-8d32-4506-842d-481662e31a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55034fcb-9d05-471a-87ee-6e1d72659cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:44 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Volume 1628cc42-ba79-4d3f-ba08-654e6d242abf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1628cc42-ba79-4d3f-ba08-654e6d242abf', 'volume_size': 1, 'snapshot_id': 'fd6d8987-7dae-42b5-8fbb-d196c90c207d'} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d-1628cc42-ba79-4d3f-ba08-654e6d242abf" by "_create_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d-1628cc42-ba79-4d3f-ba08-654e6d242abf" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Creating volume 1628cc42-ba79-4d3f-ba08-654e6d242abf from snapshot fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Selected osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8 as target Quobyte volume. {{(pid=82216) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" by "_copy_volume_from_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:44 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] snapshot: fd6d8987-7dae-42b5-8fbb-d196c90c207d, volume: 1628cc42-ba79-4d3f-ba08-654e6d242abf, {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4adfec-8e20-445c-9f52-c8f14577f555]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:45 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:45 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:45 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.458s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a10a98-5f28-40a4-9d0b-938da037de88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Creating direct copy from snapshot {{(pid=82216) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533e9a1-b50d-41b7-8fea-4a29d1bfaabb]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:45 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:45 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:45 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.463s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG cinder.utils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Path /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf not found in is_blk_device check {{(pid=82216) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 15:58:45 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:45 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf Apr 08 15:58:45 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:47 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf" returned: 0 in 1.812s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:47 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17556ba4-f20f-4ed1-b914-0dc291ad1ac6]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:47 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:47 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:47 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:48 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.574s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.image.image_utils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf {{(pid=82216) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 15:58:48 devstack cinder-volume[82216]: INFO cinder.image.image_utils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Converted 1024.00 MB image at 564.61 MB/s Apr 08 15:58:48 devstack cinder-volume[82216]: WARNING cinder.volume.drivers.remotefs [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf is being set with open permissions: ugo+rw Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:48 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf Apr 08 15:58:48 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:48 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf" returned: 0 in 0.386s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" released by "_copy_volume_from_snapshot" :: held 3.752s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d-1628cc42-ba79-4d3f-ba08-654e6d242abf" released by "_create_volume_from_snapshot" :: held 3.774s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.782s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55034fcb-9d05-471a-87ee-6e1d72659cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1628cc42-ba79-4d3f-ba08-654e6d242abf', 'volume_size': 1, 'snapshot_id': 'fd6d8987-7dae-42b5-8fbb-d196c90c207d'}' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c78f55-1f0d-4aba-98fd-cd7da4db8fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 15:58:48 devstack cinder-volume[82216]: INFO cinder.volume.flows.manager.create_volume [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Volume volume-1628cc42-ba79-4d3f-ba08-654e6d242abf (1628cc42-ba79-4d3f-ba08-654e6d242abf): created successfully Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c78f55-1f0d-4aba-98fd-cd7da4db8fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82216) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 15:58:48 devstack cinder-volume[82216]: DEBUG cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Flow 'volume_create_manager' (7e3dc412-a46b-472e-b512-a6c2a80743b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82216) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 15:58:48 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-28d57d49-7bec-46b3-b544-4f8996b3b94e tempest-SnapshotDependencyTests-1529532451 None] Created volume successfully. Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-fd6d8987-7dae-42b5-8fbb-d196c90c207d-delete_snapshot" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-fd6d8987-7dae-42b5-8fbb-d196c90c207d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" by "delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d" by "_delete_snapshot" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Deleting offline snapshot fd6d8987-7dae-42b5-8fbb-d196c90c207d of volume e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] snapshot_file for this snap is: volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75763fc5-398f-44ce-9b96-2f34a7bf7283]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:49 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:49 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:49 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.446s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.remotefs [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a10a98-5f28-40a4-9d0b-938da037de88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82216) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a94b2cf-91a0-451b-bb43-dc9ff864b253]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:49 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:49 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:49 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:50 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.443s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:50 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:50 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:50 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.445s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:50 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d Apr 08 15:58:50 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:50 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88.fd6d8987-7dae-42b5-8fbb-d196c90c207d" returned: 0 in 0.393s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-fd6d8987-7dae-42b5-8fbb-d196c90c207d" released by "_delete_snapshot" :: held 1.780s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:50 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" released by "delete_snapshot" :: held 1.792s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Created reservations ['a8b9a1ba-8e7d-46d8-bda6-d353c74c575b', '6bf458dc-3b6d-479e-a9ce-73a5934052e8', '5de36ed3-dbeb-440c-8b71-6a6982f3ef80', 'd09d073b-a742-43b7-a7b2-760c2a931a77'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:51 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Delete snapshot completed successfully. Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-4a78bc67-0be1-4673-bd4b-163532cdae39 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-fd6d8987-7dae-42b5-8fbb-d196c90c207d-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-e2a10a98-5f28-40a4-9d0b-938da037de88-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-e2a10a98-5f28-40a4-9d0b-938da037de88-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" acquired by "delete_volume" :: waited 0.008s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af288785-bf83-4065-810f-d955ff86ca35]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:51 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:51 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:51 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.467s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:51 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:51 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88 Apr 08 15:58:51 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:52 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-e2a10a98-5f28-40a4-9d0b-938da037de88" returned: 0 in 0.388s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-e2a10a98-5f28-40a4-9d0b-938da037de88" released by "delete_volume" :: held 0.891s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Created reservations ['bee651a4-81c7-4470-bf1f-55dfb2bd3f33', 'f8055633-f02c-40b0-8988-40e82d9ad522', '834148ce-923f-4595-9e0b-193e5d3ea44c', '2b816a50-b41c-4881-a4de-2ff4670745c7'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:52 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:52 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-1628cc42-ba79-4d3f-ba08-654e6d242abf-delete_volume" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-1628cc42-ba79-4d3f-ba08-654e6d242abf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" by "delete_volume" {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" acquired by "delete_volume" :: waited 0.009s {{(pid=82216) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo.privsep.daemon [-] privsep: reply[052914c9-7266-489c-a8fe-d6e2467c257f]: (4, 'qcow2') {{(pid=83125) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:52 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf Apr 08 15:58:52 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:52 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.440s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:52 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Deleted volume successfully. Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-43625af9-7718-47b3-a929-79c64bda8ceb tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-e2a10a98-5f28-40a4-9d0b-938da037de88-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:52 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf" returned: 0 in 0.477s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:52 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:52 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf Apr 08 15:58:52 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:53 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3/volume-1628cc42-ba79-4d3f-ba08-654e6d242abf" returned: 0 in 0.408s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-quobyte-1628cc42-ba79-4d3f-ba08-654e6d242abf" released by "delete_volume" :: held 0.906s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.quota [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Created reservations ['e57916f2-afbe-4524-b3fe-3408bbe8cafb', 'ef132f3d-e4cb-44dc-8637-063ccb9ddc06', 'a4735015-5d20-4f70-828f-7cdc34720d06', 'afc6b7a8-ccdd-434a-80c9-eec7a51e9df0'] {{(pid=82216) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8': None} {{(pid=82216) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.volume.drivers.quobyte [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ee43344-e04a-48a5-bea1-5b0008182cc8'] {{(pid=82216) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.lockutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 15:58:53 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3 Apr 08 15:58:53 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 15:58:53 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG oslo_concurrency.processutils [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6227bb8421af48aea76a533e1f3baf3" returned: 0 in 0.492s {{(pid=82216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.manager [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Notifying Schedulers of capabilities ... {{(pid=82216) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 15:58:53 devstack cinder-volume[82216]: INFO cinder.volume.manager [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Deleted volume successfully. Apr 08 15:58:53 devstack cinder-volume[82216]: DEBUG cinder.coordination [None req-5b5255c6-d85c-46df-a6f0-05b71660f4e5 tempest-SnapshotDependencyTests-1529532451 None] Lock "cinder-1628cc42-ba79-4d3f-ba08-654e6d242abf-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82216) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 15:59:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=173,cinder:INSERT=62,cinder:UPDATE=272,cinder:DELETE=22 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 15:59:03 devstack cinder-volume[82216]: DEBUG dbcounter [-] [82216] Writing DB stats cinder:SELECT=174,cinder:UPDATE=222,cinder:INSERT=61,cinder:DELETE=19 {{(pid=82216) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}